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MANATT, PHELPS & PHILLIPS, LLP 
JOHN L. LIBBY (Bar No. CA 128207) 

E-mail: jlibby@manatt.com 

JOHN W. MCGUINNESS (Bar No. CA 277322) 

E-mail: jmcguinness@manatt.com 
EMIL PETROSSIAN (Bar No. CA 264222) 

E-mail: epetrossian@manatt.com 
11355 West Olympic Boulevard 
Los Angeles, California 90064 
Telephone: (310)312-4000 
Facsimile: (310)312-4224 

Attorneys for Plaintiffs 

CITY OF SAN JOSE and BLACK ALLIANCE 
FOR JUST IMMIGRATION 

[Additional Counsel Listed on Signature Page] 

IN THE UNITED STATES DISTRICT COURT 

FOR THE NORTHERN DISTRICT OF CALIFORNIA 


CITY OF SAN JOSE, a municipal corporation; 
and BLACK ALLIANCE FOR JUST 
IMMIGRATION, a California Non-Profit 
Corporation, 

Plaintiffs, 

V. 

WILBUR L. ROSS, JR., in his official capacity 
as Secretary of the U.S. Department of 
Commerce; et ah. 

Defendants. 


STATE OF CALIFORNIA by and through 
Attorney General Xavier Becerra; et ah. 

Plaintiffs, 

V. 

WILBUR L. ROSS, JR., in his official capacity 
as Secretary of the U.S. Department of 
Commerce; et ah. 

Defendants. 


Case No. 3:18-cv-02279 

STIPULATION TO ADMIT TRIAL 
TRANSCRIPT IN LIEU OF 
TESTIMONY FOR DR. JOHN ABOWD; 
[PROPOSED] ORDER 

Dept: 3 

Judge: The Honorable Richard G. 

Seeborg 

Trial Date: January 7, 2019 
Complaint Filed: April 17, 2018 


Case No. 3:18-cv-01865 
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JOINT STIPULATION REGARDING TRIAL TESTIMONY OF 

DR. JOHN ABOWD 


To promote efficiency and preserve judicial resources, Plaintiffs, Plaintiff-in-Intervention, 
(collectively, “Plaintiffs”) and Defendants (collectively, “Parties”) in the cases of San Jose et al. 

V. Ross et al, 18-cv-2279, and California et al. v. Ross et al., 18-CV-1865 have reached an 
agreement regarding the admission of transcripts of Dr. John Abowd’s trial testimony in State of 
New York, et al. v. United States Department of Commerce, etal, case no. l;18-cv-02921 (“New 
York matter”). The Parties hereby stipulate as follows: 

1. The trial testimony of Dr. Abowd set forth in pages 876:1 - 1048:19 of the transcript 
of trial proceedings on November 13, 2018 in the New York matter (Dr. Abowd’s testimony 
during direct examination) attached hereto as Exhibit A shall be admitted into evidence during 
trial in the above-captioned cases. 

2. The following exhibits admitted in the New York matter during Dr. Abowd’s direct 
examination shall be admitted into evidence during trial in the above-captioned cases subject to 
Defendants’ standing objection to the admission of evidence outside of the filed administrative 
record in this case:^ PX-2 (PTX-002), PX-4 (PTX-004-A through PTX-004-D), PX-9 (PTX-009), 
PX-22 (PTX-022), PX-23 (PTX-023), PX-24 (PTX-024), PX-25 (PTX-025), PX-26 (PTX-026), 
PX-109 (PTX-110), PX-140 (PTX-141), PX-152 (PTX-153), PX-162 (PTX-160), PX-163 (PTX- 
161), PX-268 (PTX-212), PX-271 (PTX-214), PX-359 (PTX-266), PX-448 (PTX-326), and PX 
662 (PTX-465). In addition, the following exhibit identified as a demonstrative in the New York 
matter during Dr. Abowd’s direct examination shall be identified for the same purpose during 
trial in the above-captioned cases subject to Defendants’ standing objection to the admission of 
evidence outside of the filed administrative record in this case: PX 513 (PTX 359). 

3. Plaintiffs City of San Jose and Black Alliance for Just Immigration do not seek to 
admit or rely on those portions of Dr. Abowd’s testimony or exhibits which relate to the decision¬ 
making process at the U.S. Department of Commerce that led to the addition of the citizenship 

' The New York trial exhibit number is followed by the trial exhibit number in this matter 
in parentheses. 
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question to the 2020 Census. They do, however, seek to admit and rely on those portions of Dr. 
Abowd’s testimony which relate to Plaintiffs’ standing and Enumeration Clause claims. 

4. Plaintiffs in both cases reserve their right to introduce new exhibits and to cover 
additional topics in direct not covered in the New York matter. Such exhibits and questions in 
direct may be presented after the initial examination of Dr. Abowd by the Defendants. 

IT IS SO STIPULATED. 

[SIGNATURES ON THE FOLLOWING PAGE] 
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Dated; January 13, 2019 MANATT, PHELPS & PHILLIPS, LLP 

By: /s/ John F. Libby _ 

John F. Libby 

John W. McGuinness 

Emil Petrossian 

Andrew Case 

Ana G. Guardado 

Olufunmilayo O. Showole 

Salvador E. Perez 

11355 West Olympic Boulevard 

Eos Angeles, California 90064 

Telephone: (310)312-4000 

Facsimile: (310)312-4224 

LAWYERS’ COMMITTEE FOR CIVIL RIGHTS 
UNDER LAW 

Kristen Clarke 

Jon M. Greenbaum 

Ezra D. Rosenberg 

Dorian E. Spence 

1500 K Street, NW, Suite 900 

Washington, DC 20005 

Telephone: (202) 662-8600 

Facsimile; (202) 783-0857 

PUBLIC COUNSEL 

Mark Rosenbaum 
610 South Ardmore Avenue 
Los Angeles, California 90005 
Telephone: (213) 385-2977 
Facsimile: (213) 385-9089 

CITY OF SAN JOSE 

Richard Doyle, City Attorney 
Nora Frimann, Assistant City Attorney 
Office of the City Attorney 
200 East Santa Clara Street, 16th Floor 
San Jose, California 95113-1905 
Telephone Number: (408) 535-1900 
Facsimile Number: (408) 998-3131 
E-Mail: cao.main@sanjoseca.gov 

Attorneys for Plaintiffs CITY OF SAN JOSE and 
BLACK ALLIANCE FOR JUST IMMIGRATION 
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Dated; January 13, 2019 


Dated: January 13, 2019 


Dated: January 13, 2019 
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Xavier Becerra 
Attorney General of California 
Mark R. Beckington 
Anthony R. Hake 

Supervising Deputy Attorneys General 

Gabrielle D. Boutin 

Anna T. Ferrari 

Todd Grabarsky 

Noreen P. Skelly 

R. Matthew Wise 

Deputy Attorneys General 


/s/Matthew Wise _ 

R. Matthew Wise 
Deputy Attorney General 

Attorneys for Plaintiff State of California, by and through 
Attorney General Xavier Becerra 


DANNIS WOLP/ER KELLEY 
SUE ANN SALMON EVANS 
KEITH A. YEOMANS 

/s/Keith A. Yeomans _ 

KEITH A. YEOMANS 
Attorneys for Plaintiff-lntervenor 
Los Angeles Unified School District 


JOSEPH H. HUNT 
Assistant Attorney General 

BRETT A. SHUMATE 
Deputy Assistant Attorney General 

CARLOTTA P. WELLS 
Assistant Braneh Director 

/s/ Carlotta P. Wells _ 

KATE BAILEY 
STEPHEN EHRLICH 
CAROL FEDERIGHI 
Trial Attorneys 

United States Department of Justice 
Civil Division, Federal Programs Branch 
1100 L Street NW 
Washington, DC 20530 
Phone: (202) 514-9230 
Email: kate.bailey@usdoj.gov 
Attorneys for Defendants 
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FILER’S ATTESTATION 

Pursuant to Civil Local Rule 5-l(i)(3), regarding signatures, I hereby attest that 
eoneurrence in the filing of this doeument has been obtained from all signatories above. 

Dated: January 13, 2019 /s/Anna T. Ferrari 

Anna T. Ferrari 
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[PROPOSED1 ORDER 

Based on the parties’ Stipulation to Admit Trial Transcript in Lieu of Testimony for Dr. 
John Abowd, and good cause appearing, the trial testimony of Dr. Abowd set forth in pages 876:1 
- 1048:19 of the transcript of trial proceedings on November 13, 2018 in State of New York, et al. 
V. United States Department of Commerce, et al, case no. l:18-cv-02921 (the “New York 
matter”), shall be admitted into evidence during trial in the above-captioned cases. 

The following exhibits admitted in the New York matter during Dr. Abowd’s direct 
examination shall be admitted into evidence during trial in the above-captioned cases (subject to 
Defendants’ standing objection to the admission of evidence outside of the filed administrative 
record):' PX-2 (PTX-002), PX-4 (PTX-004-A through PTX-004-D), PX-9 (PTX-009), PX-22 
(PTX-022), PX-23 (PTX-023), PX-24 (PTX-024), PX-25 (PTX-025), PX-26 (PTX-026), PX-109 
(PTX-110), PX-140 (PTX-141), PX-152 (PTX-153), PX-162 (PTX-160), PX-163 (PTX-161), 
PX-268 (PTX-212), PX-271 (PTX-214), PX-359 (PTX-266), PX-448 (PTX-326), and PX 662 
(PTX-465). In addition, the following exhibit identified as a demonstrative in the New York 
matter during Dr. Abowd’s direct examination shall be identified for the same purpose during 
trial in the above-captioned cases subject to Defendants’ standing objection to the admission of 
evidence outside of the filed administrative record in this case: PX 513 (PTX 359). 

The Court acknowledges that Plaintiffs City of San Jose and Black Alliance for Just 
Immigration seek only to admit and rely on those portions of Dr. Abowd’s testimony or exhibits 
which relate to Plaintiffs’ standing and Enumeration Clause claims - and not those portions 
which relate to the decision-making process at the U.S. Department of Commerce that led to the 
addition of a citizenship question to the 2020 Census questionnaire. 

IT IS SO ORDERED. 

DATED:_ _ 

HON. RICHARD SEEBORG 
United States District Court Judge 


' The New York trial exhibit number is followed by the trial exhibit number in this matter 
in parentheses. 


STIPULATION AND [PROPOSED] ORDER - 3:18-CV-2779; 3:18-CV-01865 










Case 3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 1 of 176 


EXHIBIT A 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 


Case 3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 2 of 176 

IBD7COM1 


UNITED STATES DISTRICT COURT 
SOUTHERN DISTRICT OF NEW YORK 

-X 

STATES OF NEW YORK, COLORADO, 
CONNECTICUT, DELAWARE, ILLINOIS, 
IOWA, MARYLAND, MINNESOTA, 

NEW JERSEY, NEW MEXICO, 

NORTH CAROLINA, OREGON, 

RHODE ISLAND, VERMONT, 
and WASHINGTON, et al., 


Plaintiffs, 


V. 18 Civ. 2921 (JMF) 

UNITED STATES DEPARTMENT OF 
COMMERCE, et al., 

Trial 


Defendants. 


X 


NEW YORK IMMIGRATION 
COALITION,et al., 


Consolidated Plaintiffs, 


V. 18 Civ. 5025 (JMF) 

UNITED STATES DEPARTMENT OF 
COMMERCE, et al., 


Defendants. 


New York, N.Y. 
November 13, 2018 
9:00 a.m. 


Before: 


HON. JESSE M. FURMAN, 


District Judge 
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APPEARANCES 


BARBARA D. UNDERWOOD 

Acting Attorney General of the State of New York 
Attorney for Plaintiff State of New York 
BY: MATTHEW COLANGELO 

ELENA S. GOLDSTEIN 
DANIELLE FIDLER 
SANTA W. KAHN 
ELIZABETH MORGAN 
AJAY P. SAINT 
LAURA J. WOOD 
DAVID E. NACHMAN 
Assistants Attorney General 


ARNOLD & PORTER KAYE SCHOLER LLP 

Attorneys for Consolidated Plaintiffs NYIC 
BY: DAVID P. GERSCH 

JOHN A. FREEDMAN 
ADA ANON 
- and - 

AMERICAN CIVIL LIBERTIES UNION FOUNDATION 
BY: DALE E. HO 

DAVIN ROSBOROUGH 
SARAH E. BRANNON 

GURBIR S. GREWAL 

Attorney General of the State of New Jersey 
Attorney for Plaintiff State of New Jersey 
BY: MELISSA MEDOWAY 

Assistant Attorney General 


THOMAS J. DONOVAN, JR. 

Attorney General of the State of Vermont 
Attorney for Plaintiff State of Vermont 
BY: JULIO A. THOMPSON 

Assistant Attorney General 


ROBERT W. FERGUSON 

Attorney General of the State of Washington 
Attorney for Plaintiff State of Washington 
BY: LAURA K. CLINTON 

Assistant Attorney General 
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IbdWnys3 Abowd - Direct 

(In open court) 

JOHN MARON ABOWD, 

called as a witness by the plaintiffs, 
having been duly sworn, testified as follows: 

THE COURT: You may proceed, Mr. Ho. 

DIRECT EXAMINATION 
BY MR. HO: 

Q. Dr. Abowd, you're the chief scientist at the United States 
Census Bureau, correct? 

A. Yes, sir. 

Q. You're also associate director for research and methodology 
at the United States Census Bureau, correct? 

A. That's correct. 

Q. And in that role, you lead a directorate of research 
centers across all statistical programs of the Census Bureau, 
correct? 

A. That's correct. 

Q. You're one of the senior executives at the Census Bureau, 
correct? 

A. That's correct. 

Q. And you testified on behalf of the Census Bureau at a 
30(b)(6) deposition, correct? 

A. Yes, sir. 

Q. You assumed your current role at the Census Bureau on June 
1, 2016, correct? 


SOUTHERN DISTRICT REPORTERS, P.C. 
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IbdWnys3 Abowd - Direct 

A. Yes. 

Q. You had previously been a part-time employee at the Census 
Bureau dating back to 1998, correct? 

A. Yes. 

MR. HO: I'd like to bring up Plaintiffs' Exhibit 26. 
For the record, your Honor, this has been admitted in 
evidence, and it is part of the administrative record. 

Q. Dr. Abowd you recognize this as Secretary Ross's decision 
memo, dated March 26, 2018, directing the inclusion of a 
citizenship question on the 2020 census questionnaire, correct? 
A. Yes. 

MR. HO: I'd like to highlight on the first page the 
second paragraph. 

Q. Dr. Abowd, when this memo was issued, it was your 
understanding that Secretary Ross set out to take a hard look 
following receipt of a December 2017 request from the 
Department of Justice for census block-level citizen voting-age 
population data for purposes of enforcing the Voting Rights 
Act, correct? 

A. Yes. 

MR. HO: Let's turn to page 8 of this letter, please, 
and let's look at the first paragraph. 

Q. Dr. Abowd, you understand that Secretary Ross wrote that a 
citizenship question on the decennial census is necessary to 
provide complete and accurate data in response to the DOJ 

SOUTHERN DISTRICT REPORTERS, P.C. 

(212) 805-0300 
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IbdWnys3 Abowd - Direct 

request, correct? 

A. Correct. 

Q. And with that conclusion. Secretary Ross ordered the 
inclusion of a citizenship question on the 2020 census, 
correct? 

A. That's correct. 

Q. And Secretary Ross ordered the bureau to combine data 
collected through a citizenship question on the 2020 census 
with the use of administrative records for developing 
block-level CVAP, or citizenship voting-age population, for the 
Department of Justice, correct? 

A. He instructed us to use both the citizenship responses on 
the 2020 census and administrative data and to produce a 
citizen voting-age population by race and ethnicity table as we 
deemed best. 

Q. And Secretary Ross refers to that as option D in his memo, 
is that correct? 

A. That's correct. 

Q. Dr. Abowd, as the chief scientist at the Census Bureau, you 
do not think that adding a citizenship question to the 2020 
census is a good idea, correct? 

A. Correct. 

Q. And Dr. Abowd, the leadership of the Census Bureau does not 
think that adding a citizenship question to the 2020 census is 
a good idea, correct? 


SOUTHERN DISTRICT REPORTERS, P.C. 
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IbdWnys3 Abowd - Direct 

A. Correct. 

Q. And Dr. Abowd, your consistent recommendation has been not 
to include a citizenship question on the 2020 census, correct? 
A. Correct. 

Q. And Dr. Abowd, the consistent recommendation from the 
leadership of the Census Bureau has been not to include a 
citizenship question on the 2020 census, correct? 

A. Correct. 

Q. Let's back up for a moment. Dr. Abowd. I want to talk 
about how you arrived at those recommendations. Now, you first 
learned about the Department of Justice's December 12, 2017, 
request to add a citizenship question to the 2020 decennial 
census from Acting Census Bureau Director Ron Jarmin, correct? 
A. That's correct. 

Q. And you learned about that via email on December 15, 2017, 
correct? 

A. That's correct. 

Q. And your understanding is that the reason for the request 
was that the Department of Justice wants block-level citizen 
voting-age population data, which I'll sometimes call CVAP, for 
purposes of enforcing the Voting Rights Act of 1965, correct? 

A. That's correct. 

Q. Now, Acting Director Jarmin asked you to assemble a team of 
experts to begin discussing how the Census Bureau might respond 
to the DOJ request, correct? 


SOUTHERN DISTRICT REPORTERS, P.C. 
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IbdWnys3 Abowd - Direct 

A. He asked me to assemble a team of technical experts, that's 
correct. 

Q. And you refer to that team of technical experts as your 
SWAT team, right? 

A. That's correct. 

Q. And over the course of discussions with Dr. Jarmin, it 
became clear to you that he wanted a technical report as to how 
the Census Bureau could respond to the DOJ request, correct? 

A. That's correct. 

Q. And so you asked the SWAT team to write a white paper to 
summarize what they could learn about citizenship data that 
might be used to satisfy the DOJ request, correct? 

A. That's correct. 

Q. And you eventually wrote a memo addressed to Secretary Ross 
summarizing the work of the SWAT team, correct? 

A. Summarizing the opinions of the senior executive staff that 
were based on that work and other research done by other 
persons in the Census Bureau. 

MR. HO: Let's look at Plaintiffs' Exhibit 26, the 
Ross decision memo again. Let's look at page 4, the first 
paragraph on the page, the last sentence. 

Q. Secretary Ross writes: "So while there is widespread 
belief among many parties that adding a citizenship question 
could reduce response rates, the Census Bureau's analysis did 
not provide definitive, empirical support for that belief." Do 


SOUTHERN DISTRICT REPORTERS, P.C. 
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IbdWnys3 Abowd - Direct 

you see that. Dr. Abowd? 

A. Yes, I do. 

MR. HO: We can take that down. 

Q. Dr. Abowd, the memo that you wrote to Secretary Ross, in 
your opinion, that memo memorialized the Census Bureau's 
credible, quantitative evidence that the addition of a 
citizenship question to the 2020 census could be expected to 
lower the self-response rate in households that may contain 
noncitizens, correct? 

A. Yes, that's correct. 

Q. And you would describe noncitizens as an identifiable and 
large subpopulation, correct? 

A. We identified households that either contained a noncitizen 
or might contain a noncitizen or a person of unknown 
citizenship status as a large subpopulation, yes. 

Q. And that opinion is based upon the work of the SWAT team 
that was conducted under your direction, correct? 

A. That's correct. 

Q. And Dr. Abowd, you agree that the balance of evidence 
available suggests that adding a citizenship question to the 
2020 census would lead to a lower self-response rate in 
households that potentially contain a noncitizen, correct? 

A. Yes, I agree with that conclusion. 

Q. And the Census Bureau agrees with that conclusion, right. 
Dr. Abowd? 
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IbdWnys3 Abowd - Direct 

A. Yes, they do. 

Q. And reducing the self-response rate in that way, that's a 
bad thing, right. Dr. Abowd? 

A. I have consistently characterized data produced by lower 
self-response rates as being less accurate. 

Q. OK. I want to talk about your memo. Plaintiffs' Exhibit 

22 . 

MR. HO: For the record, this has been admitted into 
evidence and is in the administrative record. 

Q. Dr. Abowd, this is a memo that was prepared under your 
supervision, correct? 

A. I'd like to clarify that the memo that I'm familiar with 
contains a watermark with a version number on it, and this 
doesn't. 

Q. I think it may just be a function of it being on the 
screen. Do you see at the bottom of the page. Dr. Abowd, on 
the right-hand side, it has a Bates number, 1277? 

A. Yes, I see that. 

Q. Is your understanding that that number reflects the fact 

that this memo was part of the administrative record in this 
case? 

A. Yes, Bates 1277 is definitely my memo. 

Q. OK. Great. 

So this is a memo that was prepared under your supervision, 
correct? 
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IbdWnys3 Abowd - Direct 

A. Yes. 

Q. And the views are expressed in this memo are the views of 
the technical team, the SWAT team that assisted you, correct? 

A. The views in this memo are a summary of the technical work 
that that SWAT team did and the contributions made by other 
senior executives at the Census Bureau. 

Q. You agree with the conclusions in this memo, right. 

Dr. Abowd? 

A. Yes, I do. 

Q. And Acting Census Bureau Director Ron Jarmin reviewed and 
approved this memo, correct? 

A. Yes, he did. 

Q. And this is the last version of this memo, correct? 

A. Yes, it is. 

Q. This memo was routed to the secretary of commerce, correct? 
A. Yes, that's correct. 

Q. And you eventually had a meeting to discuss this memo with 
Secretary Ross on February 12, 2018, correct? 

A. Yes, that's correct. 

Q. Now, before your meeting with Secretary Ross that day, you 
had a premeeting on the same day with Undersecretary Karen Dunn 
Kelley in the Department of Commerce, correct? 

A. Yes, that's correct. 

Q. And during that premeeting with the undersecretary, you 
discussed this memo, correct? 
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A. We all discussed it, yes. 

Q. And when you met with Undersecretary Kelley, she did not 
express any disagreements with the analysis in this memo, 
correct? 

A. That's my recollection from the meeting, yes. 

Q. And during the meeting that you had with Secretary Ross 
later that day, he asked you questions that indicated to you 
that he had a thorough understanding of the issues in this 
memo, correct? 

A. Yes, that's correct. 

Q. And that was the only meeting that you had with Secretary 
Ross to discuss the citizenship question before Secretary Ross 
issued his March 26 decision memo, correct? 

A. Yes, that's correct. 

Q. So let's be clear. Secretary Ross had only one meeting 
with the chief scientist at the Census Bureau about the 
citizenship question before he issued his decision memo, 
correct? 

A. Yes, that's correct. 

Q. Now, your memo here, it addresses — I'm sorry. 

MR. HO: Let's bring up your memo. Plaintiffs' Exhibit 

22 . 

Q. It addresses three alternatives in response to the 
Department of Justice request, correct? 

A. Yes, that's correct. 
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Q. And those alternatives are. A, make no change in data 
collection; B, add a citizenship question to the 2020 census; 
and, C, obtain citizenship status from administrative records, 
correct? 

A. You didn't finish the sentence, but yes, that's correct. 

Q. You don't disagree with how I characterized it, do you. 

Dr. Abowd? 

A. I do not. 

MR. HO: Let's look at the last paragraph on the page 
and highlight it. 

Q. Dr. Abowd, you did not recommend alternative B, which was 
adding a citizenship question, correct? 

A. The memo does not recommend it, and I supervised the 
preparation of the memo, that's correct. 

Q. So you did not recommend alternative B, correct? 

A. That's correct. 

Q. In fact, you described alternative B in the memo as "very 
costly, harms the quality of the census count and would use 
substantially less accurate citizenship status data that are 
available from administrative sources," correct? 

A. Yes, that's correct. 

Q. That's adding a citizenship question, correct? 

A. Alternate B is the addition of the citizenship question to 
the 2020 census, yes. 

Q. OK. So instead of alternative B, you recommended either 
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alternative A, no change, or alternative C, using 
administrative records, correct? 

A. Yes, that's correct. 

Q. And your memo's conclusion was that using administrative 
records instead of asking the citizenship question — that is, 
alternative C — would best meet DOJ's stated uses, correct? 

A. Yes, that's correct. 

Q. And your memo concluded that that using administrative 
records instead of asking a citizenship question "is 
comparatively far less costly than alternative B, does not 
increase response burden and does not harm the quality of the 
census count," correct? 

A. That's correct. 

MR. HO: Let's talk about the analysis of alternative 
B in your memo, and I want to look at page 4 of PX-22. I'm 
looking at the header under — I'm looking at the header in 
Section B2, self-response rate analysis, and I want to ask you 
about the first paragraph here. 

Q. This paragraph is describing an analysis of unit 
nonresponse rates to the 2000 census questionnaire as compared 
to the 2000 long form, right. Dr. Abowd? 

A. Yes, that's correct. 

Q. And by unit nonresponse, we mean the rate at which people 
fail to respond to a survey, correct? 

A. Fail to self-respond, correct. 


SOUTHERN DISTRICT REPORTERS, P.C. 
(212) 805-0300 





1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 


887 


Case 3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 15 of 176 

IbdWnys3 Abowd - Direct 

Q. The 2000 short-form census questionnaire did not have a 
citizenship question on it, correct? 

A. Yes, that's correct. 

Q. But the 2000 census long form did have a citizenship 
question on it, correct? 

A. Yes, that's correct. 

Q. And so what you did here is you compared unit self-response 
rates on these two questionnaires between noncitizens, on the 
one hand, and citizen households, on the other, correct? 

A. That's not all we did, but you got the first step right, 
yes. Correct. 

Q. OK. Let's just talk about the long-form analysis. We'll 
talk about the ACS analysis in a second. 

A. Well, I meant that you hadn't completely characterized how 
we did the short and long-form analysis in 2000. 

Q. You compared the decline in self-response on the census 
long form as compared to the census short form for households 
that contain a noncitizen to that same decline for households 
that were all citizens, correct? 

A. Yes, that's correct. 

Q. OK. And when you conducted this analysis, you found that 
for both citizen households and households had that had one 
noncitizen, the response rate on the long form was lower than 
on the short form? 

A. The self-response rates on the long form were lower than 
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those on the short form, that's correct. 

Q. But for households that had one or more noncitizen in them, 
the decline in the self-response rate between the long form and 
the short form was 3.3 percentage points more than it was for 
all citizen households, correct? 

A. Yes, that's correct. 

Q. And you considered that decline to be evidence that a 
citizenship question causes households containing a noncitizen 
to self-respond to a survey at lower rates, correct? 

A. We considered that credible, quantitative evidence that 
such a question might cause a decline on the magnitude of 3.3 
percent in 2000. 

Q. OK. Now, you also conducted similar analyses for the 
American Community Survey, correct? 

A. That's correct. 

Q. And that analysis in your memo — and that analysis is 
reflected in your memo here, correct? 

A. As it existed as of January 19, that's correct. 

Q. OK. We'll get to the later analysis. Let's just stick to 
the January 19 for now. Is that all right? 

A. Yes, sir. 

Q. OK. Now, just to pause for a moment here. Dr. Abowd, I 
want to just make sure the record's clear here. Your analysis 
of unit nonresponse rates here applies not just to alternative 
B but also to option D, the choice that the secretary of 
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commerce ultimately made, correct? 

A. It would apply to any alternative in which the citizenship 
question was asked on the short form. 

Q. And that includes option D, what Secretary Ross ultimately 
ordered, correct? 

A. Yes, that's correct. 

Q. Now, before we talk about your analysis of ACS data, I just 
want to back up and ask a few questions about the ACS. 

The ACS is an ongoing sample survey, correct? 

A. Yes, that's correct. 

Q. Sent to a little more than 2 percent of the population 
annually, correct? 

A. It's sent to a larger percentage than that, but the 
responses come from between two and two and a half percent of 
the population annually. 

Q. Responses to the ACS are required by law, correct? 

A. That's correct, but the nonresponse follow-up is a sample, 
not universally selected households. 

Q. We'll talk about the nonresponse follow-up to the ACS in a 
second. I just want to make clear that just like responses to 
the decennial enumeration questionnaire are required by law, 
responses to the ACS are also required by law, correct? 

A. Yes, that's correct. 

Q. Now, the ACS contains dozens of questions, correct? 

A. Yes, at least dozens. 
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Q. And one of the questions on the ACS is a question about 
citizenship status? 

A. Yes, that's correct. 

Q. Now, your memo here has three different kinds of analyses 
of American Community Survey, or ACS, data that bear upon the 
potential adverse impact of a citizenship question on the 2020 
census, correct? 

A. I think you're referring to the Section Bl, 2 and 3 in the 
memo? 

Q. I'm referring to your analysis of unit nonresponse rates, 
item nonresponse rates and breakoff rates. 

A. Yes, that's correct. 

Q. OK. All three of those analyses bear upon the potential 
effect of a citizenship question on the 2020 census, correct? 

A. Yes, that's correct. 

Q. And it's the opinion of the executive staff of the Census 
Bureau that all three analyses were appropriate in support of 
your conclusion that using administrative records would be a 
better option for producing block-level CVAP data for VRA 
enforcement purposes than adding a citizenship question to the 
census, correct? 

A. Yes, that's correct. 

Q. And this memo included that all three analyses support the 
conclusion of an adverse impact on self-response and as a 
result on the accuracy and quality of the 2020 census, correct? 
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A. I don't remember it using adverse impact, but they support 
the conclusion that there would be a lower self-response rate 
and the consequences of that lower self-response rate, yes. 

MR. HO: OK. Let's just look at the bottom of — I'm 
sorry. At page 4 in your memo, the first two sentences there 
at the top. I'm sorry. Not the bottom but just the top, 
"before these reasons" sentence, the top paragraph on the page. 
Q. You used the term "adverse impact" to describe the effect 
of the citizenship question on self-response rates, right. 

Dr. Abowd? 

A. Thank you for refreshing my memory. Yes, I did. 

MR. HO: OK. Let's talk about your analysis of unit 
self-response rates, and let's stay on page 4 and let's look at 
the bottom paragraph, starting with "we compared." 

Q. Now, Dr. Abowd, in this paragraph, you're describing an 
analysis comparing response rates on the 2010 census to the 
2010 American Community Survey, correct? 

A. That's correct. 

Q. And the 2010 census, let's just be clear, that 
questionnaire did not have a citizenship question on it, right? 
A. That's correct. 

Q. But the 2010 ACS did have a citizenship question, right? 

A. Yes, that's correct. 

Q. And when you conducted this analysis, you found that 
self-response rates to the 2010 ACS declined more for 
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households that had one or more noncitizens in comparison to 
the 2010 census, on the one hand, as in comparison to 
households that consisted solely of citizens, correct? 

A. Yes, you've got the contrast correct. 

Q. OK. And the magnitude of that difference was 5.1 
percentage points, correct? 

A. Yes, that's correct. 

MR. HO: Let's bring up page 5 of your memo, and I 
want to ask about the first paragraph, last sentence. 

Q. You wrote that, "It is therefore a reasonable inference 
that a question on citizenship would lead to some decline in 
overall self-response because it would make the 2020 census 
modestly more burdensome in the direct sense and potentially 
much more burdensome in the indirect sense that it would lead 
to a larger decline in self-response for noncitizen 
households." Did I read that right? 

A. Yes, you did. 

Q. And when you say noncitizen households, you mean a 
household, for purposes of this analysis, that has one or more 
noncitizens in it, correct? 

A. Yes, that's correct. 

Q. Now, it's fair to say that this 5.1 percentage point 
estimate at the time, that you considered that a conservative 
estimate of the differential impact of a citizenship question 
on the self-response rates of noncitizens as compared to 
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citizens if you were to place such a question on the 2020 
census, correct? 

A. Yes, I believe I have characterized that estimate as 
conservative, but we haven't discussed exactly what a 
statistician might mean by conservative. What I mean in this 
context is that it is performed in the context of a natural 
experiment, although you haven't used those words yet. 

THE WITNESS: Your Honor, "natural experiment" is the 
technical name for the way this analysis was conducted. Happy 
to elaborate if you have questions. 

BY MR. HO: 

Q. I'll have plenty of questions unpacking what you mean by 
conservative, and we're going to spend some talking about what 
a natural experiment means too. Dr. Abowd. Don't worry. But 
let's just stick with my questions for now, and my question is 
at the time that you wrote this memo, 5.1 percentage points was 
your best conservative estimate of the effect of adding a 
citizenship question in terms of the differential impact of 
self-responses of noncitizen households as compared to citizen 
households if you were to put that question on the 2020 census. 
Correct? 

A. Yes, that's correct. 

MR. HO: Let's turn to page 6 of your memo. I want to 
ask you about the middle paragraph, the last sentence. I'm 
sorry. Not the last sentence, just the middle paragraph here. 
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Q. Now, in this memo, for purposes of calculating some of your 
estimates, you expect there are about 126 million occupied 
households to be enumerated in the 2020 census, is that right? 
A. Yes, that's correct. 

Q. And you estimate that 9.8 percent of households contained 
at least one noncitizen, correct? 

A. Yes, that's correct. 

Q. And so a reduction of 5.1 percentage points in the 
self-response of those households would translate to about 
630,000 households, correct? 

A. 630,000 households in NRFU that would not otherwise have 
been there, yes. 

Q. OK. And that likely translates into millions of people, 
right. Dr. Abowd? 

A. At average household sizes, it's more than a million 
people, yes. 

Q. Now, today, the Census Bureau's best conservative estimate 
of the differential effect of adding a citizenship question to 
the census in terms of self-responses of all citizen households 
to other households is not 5.1 percentage points, right. 

Dr. Abowd? 

A. Yes, that's correct. 

Q. Today, the best conservative estimate of the Census Bureau 
for that differential effect in self-response is 5.8 percentage 
points, correct? 
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A. Best estimate we have at the moment is 5.8 percentage 
points. 

MR. HO: OK. Let's bring up Plaintiffs' Exhibit 162, 
which is also Defendants' Exhibit 2. For the record, it's been 
admitted. 

Q. Dr. Abowd, we talked about a white paper earlier and how 
you were charged with putting a white paper together. Do you 
remember that? 

A. Yes, I do. 

Q. Is this the white paper? 

A. This is the most recent version of the technical report 
performed under my supervision, yes. 

Q. And you've been sitting through trial for the last week or 
so; sometimes people have referred to this as the Brown memo 
during their testimony, right? 

A. Yes, I believe that's right. 

Q. OK, so white paper. Brown memo, different colors, different 
names, but the same document, right? 

A. Yes, in deference to the authors, I usually call it Brown 
et al . 

Q. OK. The analysis in Brown et al., or the white paper, that 
was begun in response to the Department of Justice's request 
for block-level CVAP data, correct? 

A. Yes, that's correct. 

Q. And the authors of this paper, they're a subset of the SWAT 


SOUTHERN DISTRICT REPORTERS, P.C. 
(212) 805-0300 





1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 


896 


Case 3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 24 of 176 

IbdWnys3 Abowd - Direct 

team that you assembled, right? 

A. Yes, that's correct. 

Q. And you chose the best people at the Census Bureau for 
conducting the analysis that's reflected in the Brown memo, 
correct? 

A. Yes, I did. 

Q. And this white paper, this version here, dated August 6, 
2016, you've described this as an extended and more up-to-date 
version of the analysis that you relied on when you prepared 
your January memo to Secretary Ross, Plaintiffs' Exhibit 22, 
right? 

A. Yes, I did. 

Q. Now, this is the most recent version of the white paper 
available, correct? 

A. Yes, it is. 

MR. HO: Just as a brief aside, I want to bring up 
Plaintiffs' Exhibit 4, and I want to look at page AR-11634, 
which should be about page 8,000-something in here. Sorry. 

Q. While he's bringing this on the screen, I just want to ask 
you. Dr. Abowd, your understanding is that there's an earlier 
draft of the Brown et al. paper, the white memo that is 
contained in the administrative record in this case, right? 

A. It's my understanding that an earlier draft was produced in 
discovery, yes. 

Q. And is part of the administrative record in this case. 
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correct? 

A. I believe there's some discussion on the record of finding 
the Bates number for it, but that is my understanding, yes. 

Q. OK. We'll come back to this and identify it at a later 
time, but I just want to ask you. Dr. Abowd, you believe that 
the analysis reflected in the Brown et al. memo was 
methodologically appropriate, right? 

A. Yes, I do. 

Q. And you believe that the Brown memo constitutes the best 
analysis that the Census Bureau can do of the consequences of 
adding the citizenship question to the 2020 census, right? 

A. With the available data, correct. 

Q. And there are no conclusions in the Brown memo that the 
Census Bureau disagrees with, correct? 

A. That's correct. 

Q. CK. The analysis that produced the 5.8 percentage point 
estimate, the best conservative estimate of the differential 
effect of the citizenship question on self-responses, that's 
contained in the Brown memo, right? 

A. Yes, it is. 

MR. HC: Let's turn to page 39 of the Brown memo. 

Q. And looking at table 9, the second panel here on table 9, 
on the bottom half of the table, with the minus 5.8 percentage 
point figure there, that's the, where the.58 percentage point 
estimate is found in this paper, correct? 
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A. Yes, that's correct. 

Q. Now, several factors account for the difference between 
your current best estimate of 5.8 percentage points and your 
older estimate of 5.1 percentage points, correct? 


A. 

Yes, 

that's 

correct. 


Q. 

OK. 

I want 

to talk through some of these. 

One difference. 


one factor that accounts for the difference is you compared 
different households at this time, right? 

A. The comparison households are constructed differently, 
that's correct. 

Q. Right, so for the 5.1 percentage point estimate, you 
compared households that were all citizen, as identified in the 
administrative records, to households that had one or more 
noncitizens, as identified in the administrative records, 
right? 

A. That's correct. 

Q. And for the 5.8 percent comparison, you compared households 
for which their ACS response was "all members of the household 
are citizens" and the administrative records indicate that 
they're all citizens, on the one hand, and all the other 
households, on the other hand, correct? 

A. Yes, that's correct. 

Q. Another difference is that the 5.8 percentage point 
estimate is based on more recent ACS data, correct? 

A. It's based on the 2016 ACS data, that's correct. 
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Q. Right, so the 5.1 percentage point estimate, that's based 
on a comparison of 2010 decennial census response rates and 
2010 ACS response rates whereas the 5.8 percentage point 
estimate, that's based on a comparison of 2010 decennial 
response rates to 2016 ACS response rates, correct? 

A. Yes, that's correct. 

(Continued on next page) 
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BY MR. HO: 

Q. And the reason you like the 5.8 percentage point estimate 
better is because you think that when you're trying to assess 
the impact of a citizenship question today, it is more reliable 
to use more recent ACS data, correct? 

A. You wanted more currency, that's correct. 

Q. And you view this five point — I'm sorry. Let me start 
that question again. 

When you look at that 5.8 percentage point estimate and you 
view it in light of the 3.3 percentage point estimate from the 
2000 short form and long form comparison and the 5.1 percentage 
point estimate from the 2010 census and ACS 2010 ACS 
comparison, you agree that this 5.8 percentage point figure is 
an indicator that nonresponse rates to surveys with a 
citizenship question are increasing for households that might 
have a noncitizen, right? 

A. I think we discussed this before. I've said that I am 
reluctant as a statistician to fit a trim line to those three 
numbers, but I did say that 5.8 is bigger than 5.1 and 5.1 is 
bigger than 3.3. 

Q. Dr. Abowd, the 5.8 percentage point estimate, that is a 
conservative estimate, right? 

A. We still haven't discussed what a statistician would mean 
by conservative, but assuming we are using that as an undefined 
term for the moment, yes. 
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Q. Lets define it. 

One of the reasons why you consider the 5.8 percentage 
point estimate conservative is that it is based on ACS data, 
right, but the citizenship question could have more prominence 
on the decennial census questionnaire, correct? 

A. The reason that I have characterized the 5.8 percentage 
point estimate as conservative is because it was translated 
into what I believe, and others at the Census Bureau believe, 
is a conservative estimate of the cost implications of that 
self-response. 

As a point estimate itself, it is what it is. It 
is the best available point estimate of the decline in 
self-response that the data could produce. So it was used in a 
conservative way in the sense that it produced a conservative 
cost estimate. A point estimate has a standard error band 
around it, and in that sense, it is as good as the analysis 
that led up to it can be for the purposes of estimating the 
decline in self-response rates. 

Q. Dr. Abowd, I didn't ask you about all the different reasons 
why you would describe it as a conservative estimate. My 
question was much simpler than that. It was simply this. 

Cne reason why the 5.8 percentage point estimate is 
conservative is because it is based on a comparison of 
self-response rates on the ACS, but a citizenship question on 
the decennial census questionnaire, which is much shorter. 
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could have much more prominence. 

You agree with that, right. Dr. Abowd? 

A. I didn't think I heard the "could" the first time, but yes, 
I do agree with that statement. 

Q. Now, the greater prominence of a citizenship question on 
the decennial census questionnaire means that it could have a 
larger effect in terms of depressing self-response rates to the 
questionnaire than a citizenship question would have when 
placed among the dozens of questions on the ACS, correct? 

A. That's what could have a greater impact means, yes. 

Q. Now, another issue is that the 5.8 percentage point 
estimate as we discussed earlier, that is based on 2016 data, 
which is more recent than 2010 data, right? 

A. Yes, that's correct. 

Q. And, Dr. Abowd, you agree that a question that was already 
sensitive at one point could become more sensitive at a later 
time due to a change in the political environment, right? 

A. Yes, it could. 

Q. And it is safe to say that if something happened after 2016 
that might have made citizenship a more salient issue, that 
that would not be reflected in your 5.8 percentage point 
estimate, correct? 

A. Anything that happened after 2016 would not be reflected in 
that estimate, correct. 

Q. OK. We'll come back to that later. 


SOUTHERN DISTRICT REPORTERS, P.C. 
(212) 805-0300 





1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 


903 


Case 3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 31 of 176 

IBDsNYS4 Abowd - Direct 

But just to round out the issues. Dr. Abowd, one other 
issue is that the 5.8 percentage point estimate, that's only an 
estimate about the reduction in self-response for households 
where everyone has not been confirmed to be a citizen, correct? 
A. That's correct. 

Q. So it doesn't take into account any reduction in 
self-response rates from all citizen households, correct? 

A. That's correct. 

Q. You would agree that the assumption that a citizenship 
question on the census in 2020 will have no effect on all 
citizen households, that that assumption is probably wrong, 
right. Dr. Abowd? 

A. That is an assumption and there is no evidence in the data 
to say whether it is right or wrong. 

Q. But you think. Dr. Abowd, that to assume that a citizenship 
question would have no effect on all citizen households, that 
to make that assumption, that would probably be wrong, right 
Dr. Abowd? 

A. It would be better to have information about how all 
citizen households actually responded to a citizenship question 
on the census. 

Q. Dr. Abowd, do you remember giving a deposition in this case 
on October 12, 2018? 

A. There were so many. Yes, I do. 

Q. I believe it was your fourth deposition in the case. 
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A. Yes, it was. 

Q. OK. Can we bring up that deposition transcript and page 
198, starting at line 7, please. 

Dr. Abowd, you were under oath that day, correct? 

A. Yes, I was. 

Q. And you told the truth that day, correct? 

A. Yes, I did. 

Q. All right. 

"Q. And what's your basis for saying it would fall in that 
part of the range? 

"A. The — the recent data that we analyzed underlies the 5.8 
percent and 28.6 percent that's in column two, give you — on 
this estimate, 82.5 million and, in the working paper, 91.2 
million. No significance should be attributed to that 
difference in the estimate. It has to do with the base that 
was used in calculating them. 

We said in our advice to the secretary, and I continue to 
believe in my expert opinion, that that's a lower bound, a 
cautious estimate, and that the hypothesis underlying that 
estimate that there won't be any effect in the households that 
have citizens is probably wrong. It's only maintained in order 
to be able to say something about the target population, which 
is the ones that might have a noncitizen or that definitely 
have a noncitizen. 

Q. Was that the question that was posed to you that day and 
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your answer to it? 

A. Yes, they were. 

Q. Dr. Abowd, to the best of your knowledge, no one at the 
Census Bureau has conducted any statistical analysis 
specifically addressing the question of whether even among 
households that are all citizens, the inclusion of a 
citizenship question could have some effect on their response 
rates, correct? 

A. That's correct. 

Q. I want to talk about a different analysis in your January 
memo. Plaintiffs' Exhibit 22, about the effect of the 
citizenship question that's not exclusively about noncitizen 
households. And lets turn to page four in your memory and the 
header Bl, quality of citizenship responses. 

Now, in this section of your memo. Dr. Abowd, you discuss 
item nonresponse rates for the citizenship question on the 
American Community Survey, correct? 

A. Yes, that's correct. 

Q. And item nonresponse is different from unit nonresponse, 
right? 

A. Yes, that's correct. 

Q. Item nonresponse is when someone returns a survey, but they 
don't answer a particular question on that survey, correct? 

A. That's correct. 

Q. OK. I want to focus on the second paragraph under this 
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header. Starting with in the period. 

Now, in this paragraph, you're describing an analysis of 
item nonresponse rates to the citizenship question on the 
American Community Survey, right? 

A. Yes, that's correct. 

Q. And you're looking at item nonresponse rates on the 
American Community Survey from 2013 to 2016, right? 

A. Yes, that's correct. 

Q. And in that analysis, you're comparing racial and ethnic 
subgroups, correct? 

A. Yes. 

Q. And you found that the item nonresponse rate to the 
citizenship question for the mail in ACS for non-Hispanic 
whites during this period raged from 6 to 6.3 percent, correct? 
A. Yes. 

Q. And you also found that during the same period, the item 
nonresponse on the citizenship question for the mail in ACS for 
non-Hispanic blacks ranged from 12 percent to 12.6 percent, 
correct? 

A. Correct. 

Q. So that is twice as high as the item nonresponse rate 
during this period on the ACS citizenship question for blacks 
as compared to non-Hispanic whites, correct? 

A. Correct. 

Q. You also found during this period that the item nonresponse 
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rate on the citizenship question for the mail-in ACS for 
Hispanics ranged from 11.6 percent to 12.3 percent, correct? 

A. Correct. 

Q. And you also looked at the ISR instrument. 

That's the Internet version of the ACS, correct? 

A. Yes, that's correct. 

Q. So in 2016, the Internet ACS item nonresponse rates for the 
citizenship question for non-Hispanic whites was 6.2 percent, 
correct? 

A. Yes. 

Q. But for Hispanics, the item nonresponse rate to the 
citizenship question on the Internet version of the ACS was 
more than twice as high, it was 15.5 percent, correct? 

A. I am pausing because you highlighted the 2013 answer first, 
and then the 2016 answer, I think. Unless I'm just confused 
reading the text. 

Q. I think you're right. But the numbers for item nonresponse 
on the 2013 and 2016 ISR for non-Hispanic whites were the same, 
right. Dr. Abowd, 6.2 percent? 

A. Yes. OK. All right. 

Q. If we compare the 2016 ACS item nonresponse for 
non-Hispanic whites to Hispanics, it is 6.2 percent for 
non-Hispanic whites, 15.5 percent for Hispanic whites? 

A. That's correct. 

Q. More than twice as high for Hispanics, correct? 
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A. Correct. 

Q. You would characterize the item nonresponse rate for 
Hispanics on the 2016 ACS Internet version for the citizenship 
question as much higher than they are for non-Hispanic whites, 
right? 

A. I believe that is what I said, yes. 

THE COURT: Can I interrupt for one moment? 

Can you tell me what the Internet version of the ACS 
is, who does that, and how it differs? 

THE WITNESS: Yes, your Honor. 

American Community Survey has a fixed set of 
questions, but they are delivered in two formats. One is a 
paper questionnaire that you fill out with pencil and mail 
back, but you can also elect to do it online. And you go to 
our website and you bring up the questionnaire and put in your 
invitation to respond, and then you're asked the questions in 
an online instrument. You are still self-administering. You 
take the ACS in an Internet instrument, which we call an 
Internet self-response instrument. 

THE COURT: All right. When you say invited to, is 
that you received the form in the mail and it instructs you 
that you can either fill it out and mail it back, or 
alternatively, you can go online and do it online? 

THE WITNESS: That's correct. 

THE COURT: What proportion of the people who respond 
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use the Internet version versus the paper version? 

THE WITNESS: Oh, I have memorized so many numbers 
for this trial. I don't have that one memorized. 

It is a substantially higher proportion use the 
Internet self-response instrument than the mail-back 
instrument, but I don't recall the exact proportions, your 
Honor. 

THE COURT: Do you know or do you have an opinion why 
the rates would differ on the Internet version versus the paper 
version? 

Is there some difference that you know of or 
understand with respect to the population that does it on the 
internet versus mailing it in? 

THE WITNESS: Generically, the reason why the item 
nonresponse rates differ on an Internet self-response 
instrument is because we sometimes prompt and we sometimes let 
the items go through without prompting. We generally prompt on 
demographic items, including items, like, race and ethnicity. 

THE COURT: When you say prompt, what do you mean? 

THE WITNESS: Make sure that the respondent didn't 
want to respond to that question. 

THE COURT: So in other words, you would say are you 
sure you didn't want to respond to the previous question or 
something of that nature? 

THE WITNESS: Yes, something like that. 
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THE COURT: And obviously you can't do that on the 
paper form? 

THE WITNESS: That's correct. 

THE COURT: Mr. Ho. 

MR. HO: Thank you, your Honor. 

BY MR. HO: 

Q. Dr. Abowd, you included this analysis of item nonresponse 
to the citizenship question on the American Community Survey 
because it suggests or, I'm sorry, because it is suggestive 
statistical evidence that a citizenship question on the census 
could see higher nonresponse rates from Hispanics as compared 
to non-Hispanic whites, correct? 

A. Yes. 

Q. I just want to talk about change over time here. 

According to your memo for non-Hispanic whites, the item 
nonresponse rate to the citizenship question on the ACS between 
2013 and 2016 either didn't change at all on the Internet or 
didn't change much for the mail-in version, right? 

A. For which group? 

Q. Non-Hispanic whites. 

A. Correct. 

Q. But item nonresponse to the citizenship question on the ACS 
increased for Hispanics during the same period of time, 
correct? 

A. Yes, it did. I think it is called out on the paragraph 


SOUTHERN DISTRICT REPORTERS, P.C. 
(212) 805-0300 





1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 


911 


Case 3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 39 of 176 

IBDsNYS4 Abowd - Direct 

there. 

Q. OK. Lets look at how you analyzed this in the Brown, 
et al . memo. Plaintiffs' Exhibit 162. I want to look at page 
nine, figure two. 

THE COURT: While we're doing that, let me go back to 
what I asked before. 

I would think, just intuitively, that the prompt would 
actually increase the response rate because it would catch some 
people who might not have meant to skip it. 

Why would you point to that as a reason that it would 
actually be higher? 

THE WITNESS: I apologize, your Honor. I gave you the 
explanation for why we generally get low nonresponse rates on 
self-response than on paper. 

In this case, it is probably a difference in the 
proporation of people from the different sub populations who 
respond in the two modes. 

THE COURT: Meaning? 

THE WITNESS: I don't have any specific data with me. 
THE COURT: So your opinion or speculation is that 
when you say difference just in terms of the kinds of the 
people who elect to respond online versus on paper, that there 
is some difference in that population? 

THE WITNESS: Yes. Yes, that's right. 

THE COURT: All right. 
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You may proceed, Mr. Ho. 

MR. HO: Thank you, your Honor. 

BY MR. HO: 

Q. Now, during this same period that we have been discussing, 
2013 to 2016, item nonresponse for Hispanic to the question 
about sex, that is, are you male or female on the American 
Community Survey declined, correct? 

A. So that is the blue checkered or dotted bars, and they are 
all below the zero line. So yes, correct. 

Q. Just so the record is clear, between 2013 and 2016, item 
nonresponse for Hispanic on the citizenship question increased 
but item nonresponse on the question about sex decreased, 
correct? 

A. Yes. 

Q. So, Dr. Abowd, it is correct to say that the increase in 
item nonresponse to the citizenship question on the ACS among 
Hispanic does not reflect a trend of item nonresponse to all 
questions increasing during that same period, correct? 

A. Yes, that would be a correct conclusion. 

Q. I want to talk about the third analysis in your January 
memo, the one related to breakoff rates. 

Lets turn back to Plaintiffs' Exhibit 22. 

THE COURT: Before we do that, this chart is for 
Hispanic respondents? 

THE WITNESS: Your Honor, the chart has three 
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different questions on it. The item nonresponse rate for sex, 
which is the blue bar; for age, which is the — I think that is 
orange, might be red hashed bar; and for citizenship, which is 
the gray bar. 

Then the first set of three bars is for all 
respondents. The next set is non-Hispanic white. 

THE COURT: I missed the bottom labels. Sorry about 
that. Thank you. 

THE WITNESS: No problem. 

MR. HO: I'm sorry. I should have pointed that out, 
your Honor. 

BY MR. HO: 

Q. Can we now turn to the breakoff rate analysis, the third 
analysis in your January memo, page five of Plaintiffs' 

Exhibit 22. I want to look under header B3, breakoff rate 
analysis. 

This is the part of your memo where you describe the 
analysis of breakoff data for the 2016 ACS, correct? 

A. Yes, it is. 

Q. Just to define it, a breakoff rate is the rate at which, 
when people are responding to the ACS questionnaire online, 
they stop answering the survey upon encountering a screen with 
a particular question, correct? 

A. Yes, that is how it is defined. 

Q. In 2016, breakoff rates on the citizenship question on the 
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ACS for Hispanic were much higher than they were for 
non-Hispanic whites, correct? 

A. I think you're summarizing the second sentence in the 
second paragraph, and that's correct. 

Q. As the data is presented in this memo, the breakoff rate on 
the citizenship question on the 2016 ACS for Hispanic was eight 
times what it was for non-Hispanic whites, correct? 

A. Yes, that's correct. 

Q. This breakoff rate analysis indicates that the citizenship 
question is more sensitive for Hispanic than for non-Hispanic 
whites, correct? 

A. That is what we concluded, correct. 

Q. Now, it is also correct. Dr. Abowd, that the difference in 

breakoff rates for Hispanic as compared to non-Hispanic whites 
is much higher for questions concerning year of entry and 
citizenship than for any other of the questions on the ACS with 
the exception of English proficiency, correct? 

A. So I'm happy to go over those data with you if you bring up 
the chart, but I don't have them memorized. It is one of the 
high breakoff rates. I am willing to say that without seeing 
the table. 

Q. OK. Lets bring up the white paper. Plaintiffs' Exhibit 

162, and page ten. Lets look at the last paragraph here. 

Starting with the second to last sentence, citizenship 
related questions. Why don't you go ahead and read that to 
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yourself. Dr. Abowd, and let me know when you're ready. 

(Pause) 

A. Yes, I've read it. 

Q. So it is correct, right. Dr. Abowd, that breakoff rates for 
the citizenship question on the ACS for Hispanics are much 
higher than for non-Hispanic whites generally, first of all, 
that's correct, right? 

A. That's correct. 

Q. And that the difference between those breakoff rates is 
higher for questions concerning year of entry and citizenship 
than for any other question on the ACS, with the exception of 
English language proficiency, correct? 

A. Yes, that's correct. 

Q. Now, your January memo presents only 2016 ACS breakoff 
data, correct? 

A. That's correct. 

Q. But the Brown memo here also has 20 — I'm sorry. Strike 
that. 

The reason why your memo to Secretary Ross only has 2016 
breakoff data in it is because the 2017 ACS breakoff data was 
incomplete as of that time, correct? 

A. That's correct. 

Q. But the swat team has looked at 2017 ACS breakoff data, 
right? 

A. Yes, they are. 
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Q. And the Census Bureau has now made the 2017 ACS breakoff 
data available as part of this litigation, correct? 

A. We released it as a public document, yes. 

Q. OK. Lets turn to Plaintiffs' Exhibit 9. This has been 
admitted. 

Dr. Abowd, this is a table summarizing the rate at which 
different groups break off on the ACS on different questions, 
correct? 

A. Yes. That's correct. 

Q. If we go down to citizenship, the left-hand column, the 
breakoff rate for non-Hispanic whites on the citizenship 
question in the 2017 ACS is .03489, correct? 

A. Yes, I see it. Yes, that's correct. 

Q. OK. The citizenship question breakoff rate on the 2017 ACS 
for Hispanic is .4343, correct? 

A. The highlighting just disappeared. 

Yes, that's correct. 

Q. OK. So just to summarize this, it is correct to say that 
the citizenship question breakoff rate on the 2017 ACS for 
Hispanic is more than 12 times what it is for non-Hispanic 
whites, correct? 

A. Yes, that's correct. 

Q. OK. So just to summarize, in 2016, the Hispanic breakoff 
rate was eight times what it was for whites, in 2017, it was 
12 times what it was for whites, correct? 
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MR. EHRLICH: Objection, asked and answered. 

THE COURT: Overruled. 

A. Yes, it's correct. 

Q. It is fair to say that in your January memo to Secretary 
Ross, you concluded that adding a citizenship question would be 
a sensitive question for Hispanics, correct? 

A. I believe we did, yes. 

Q. You believe. Dr. Abowd, that Hispanic are more sensitive to 
survey questions about citizenship than they were a few years 
ago, correct? 

A. Yes, that is what's the data appear to show. 

Q. That increased sensitivity, you would agree, is reflected 
in the 2017 ACS data, correct? 

A. Increased sensitivity is reflected in the 2017 data, yes. 

Q. That postdates your 5.8 percentage point estimate, which 
was based only on data through the 2016 ACS, correct? 

A. That's correct. 

Q. Non-Hispanic whites by contrast. Dr. Abowd, are not more 
sensitive to survey questions about citizenship than they were 
a few years ago, correct? 

A. I think, are you characterizing all the evidence? 

In which case I think that is probably right. 

Q. Yes. 

A. OK. 

Q. I am characterizing all of the evidence. 
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Is that correct? 

A. Yes. 

Q. Dr. Abowd, the Census Bureau believes that Hispanics will 
respond to the citizenship question on the 2020 census at lower 
rates than non-Hispanic whites, correct? 

A. To the extent that Hispanicity is related — to ethnic 
origin Hispanic is related to a household that potentially 
contains at least one noncitizen, we have credible quantitative 
evidence that there could be a lower self-response rate, yes. 

Q. Dr. Abowd, it is fair to say that you believe that unit 
self-response rates, that is, refusing to self-respond to the 
2020 census questionnaire at all, that that will happen at a 
higher rate for Hispanics than non-Hispanic whites as a result 
of the citizenship question, correct? 

A. So what I think I've said consistently is the Hispanic 
origin, Hispanic ethnicity, is highly correlated with being in 
what we would call the treatment group from that natural 
experiment. To the extent that that correlation is true. The 
conclusions of the natural experiment hold. 

Q. The answer to my question is yes. Dr. Abowd? 

A. I am trying to qualify that we didn't specifically analyze 
it for Hispanics, because that is not the question that the 
data analysis addressed. 

But I concur that they are highly correlated with the 
households that may include a noncitizen or person of unknown 
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citizenship status. 

To that extent, the conclusion is correct. 

Q. Dr. Abowd, you agree, do you not, that the analysis of item 
nonresponse on the ACS and breakoff rates to the ACS for 
Hispanics suggests that response rates to the 2020 census will 
fall more for Hispanics than for non-Hispanic whites as a 
result of the citizenship question, correct? 

A. Item response rates on the citizenship question, that's 
what that shows. 

Q. That's not my question. Dr. Abowd. 

A. That is why I answered what I did. 

Q. OK. But my question. Dr. Abowd, is this: You agree, do 
you not, that the item nonresponse rate analysis that you 
conducted for the ACS and the breakoff rate analysis that you 
conducted for the ACS, suggest that unit nonresponse on the 
2020 census will decline more for Hispanics than for 
non-Hispanic whites as a result of the citizenship question, 
correct? 

MR. EHRLICH: Objection. 

THE COURT: Basis? 

MR. EHRLICH: Asked and answered several times, your 

Honor. 

THE COURT: I don't think it has been answered. 
Overruled. 

A. I imagine you're going to show me in the record why you 
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think I've already said that. 

All I want to say is that, to the extent that Hispanic 
and being in the treatment group for the natural experiment are 
highly correlated, that would justify that conclusion. 

The breakoff analysis and the item analysis justify 
the conclusion that the citizenship question itself won't be 
responded to as at higher rate by Hispanics. 

THE COURT: Is there a high correlation between the 
treatment group and Hispanic origin? 

THE WITNESS: Yes, your Honor, there is. 

MR. HO: Thank you, your Honor. 

BY MR. HO: 

Q. You used the phrase natural experiment or the term natural 
experiment before. 

Do you remember that. Dr. Abowd? 

A. Yes, I do. 

Q. Would you agree that a natural experiment is an 
observational study in which one group of individuals has been 
exposed to control conditions while another group has been 
exposed to treatment conditions, such that a change in outcome 
between the two groups could plausibly be ascribed to the 
treatment? 

A. I agree with everything that you said and would add that 
the definitions that put you into either the treatment or the 
control group have to contain some element of natural 
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randomization. 

Q. Here, the control is for purpose — when we talk about the 
natural experiments that you conducted here, the control is the 
2010 decennial census questionnaire without a citizenship 
question, and the treatment is the 2010 ACS or the 2016 ACS, 
which has a citizenship question, correct? 

A. Technically, the treatment is the change, but yes, that's 
basically right. 

Q. The premise then behind this natural experiment is that it 
is reasonable to infer that a differential lower self-response 
on the ACS questionnaire for households that have a noncitizen 
or a person of unknown citizenship status is due to the 
citizenship question on the ACS, which is sensitive for that 
population, correct? 

A. So the goal of the natural experiment is to do that 
difference indifference with the plausible, the actual 
randomization, which in this case is who got the ACS — that's 
a random subset of the population — and then to explore the 
answer you get to make sure that there aren't confounders that 
could have explained that difference in the case of the 
comparison of the ACS to the 2010 census. There are potential 
confounders. So the initial analysis did not make any effort 
to control for those confounders and the subsequent analyses 
did. 

Q. Dr. Abowd, you would characterize the analysis that is 
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reflected in your January memo as a well-designed natural 
experiment, correct? 

A. Yes. 

Q. Dr. Abowd, notwithstanding what Secretary Ross says in his 
memo about evidence of an effect of a citizenship question on 
self-response rates, you believe that the Census Bureau did 
provide empirical support for its belief that adding a 
citizenship question will reduce response rates to the 2020 
census, correct? 

A. Self-response rates, correct. 

Q. And, in fact. Dr. Abowd, when you met with Secretary Ross 
on February 12, you told him that the Census Bureau thought 
that the difference in self-response rates on the ACS and the 
census, when comparing citizen and noncitizen households, was 
probably related to the citizenship question on the ACS, 
correct? 

A. That's my recollection, yes. 

Q. Dr. Abowd, I want to bring up again your January memo. 
Plaintiffs' Exhibit 22, page five. I want to look at the last 
sentence. 

I'm sorry. We want Dr. Abowd's January memo, which I 
believe is Plaintiffs' Exhibit 22. Maybe I have that number 
wrong. 

THE COURT: I believe that is right. 

MR. HO: It is 22, page five. I want to look at the 
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last sentence. 

Sorry. The last sentence of the first paragraph. 
Excuse me. 

Sorry. I guess I have this wrong again. The top 
paragraph, last sentence. 

Thanks. 

BY MR. HO: 

Q. You wrote in your memo: It is therefore a reasonable 
inference that a question on citizenship would lead to some 
decline in overall self-response because it would make the 
2020 census modestly more burdensome in the direct sense and 
potentially much more burdensome in the indirect sense that it 
would lead to a larger decline in self-response for noncitizen 
households, correct? 

A. That is what it says, yes. 

Q. And here, that is consistent with what your opinion is 
about having produced credible qualitative evidence of the 
effect of the citizenship question on self-response rates, 
correct? 

A. Yes, that's correct. 

Q. Now, this opinion, which is based on a natural experiment. 
Dr. Abowd, that is not the same as a randomized control test or 
RCT, correct? 

A. That's correct. 

Q. If you had done an RCT, that would have been if you had 
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conducted a new randomized experiment with control and 
treatment groups instead of trying to observe something that 
had already occurred, correct? 

A. There is more to it than that, but that is — all that you 
said is correct. 

Q. OK. An RCT, that would provide what you would describe 
as gold standard evidence for assessing the effect of a 
citizenship question on response rates, correct? 

A. Yes, that's correct. 

Q. OK. If the Census Bureau had conducted an RCT, it would 
have had quantitative data that could isolate the effect of a 
citizenship question in terms of how that would perform in the 
context of the decennial census enumeration questionnaire, 
correct? 

A. If there had been an RCT available, we would have been able 
to make an internally valid comparison of a questionnaire with 
and without a citizenship question as to its effect on 
self-response rates for the whole population. 

Q. Do you remember in Secretary Ross' memo where he uses the 
word isolate and he said that the Census Bureau could not 
isolate the percentage in the self-response decline that could 
be attributable to the citizenship question? 

Does that ring a bell? 

A. A sentence like that rings a bell, yes. 

Q. If you had conducted an RCT, you could have isolated the 
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effect of the citizenship question on self-response rates in 
the way that Secretary Ross described, correct? 

A. I think I've said consistently that I am very reluctant to 
interpret what the Secretary meant by sentences in his memo. 

If we had run a randomized control trial on self-response 
rates, we would have been able to say, without qualification, 
that the difference between the self-response rate with and 
without a citizenship question was X. 

THE COURT: And putting aside what the Secretary may 
or may not have meant, I take it an RCT would allow you to 
isolate the effect of a particular question on response rates? 

THE WITNESS: Yes, it would, your Honor. 

Q. Dr. Abowd, there has been no RCT of the census enumeration 
questionnaire with the citizenship question, correct? 

A. That's correct. 

Q. A group of decision-makers, including Commerce Under 
Secretary Karen Dunn Kelley decided not to conduct an RCT of 
the citizenship question, correct? 

A. A group of decision-makers at the Census Bureau with 
collaboration of the Under Secretary decided not to conduct a 
randomized controlled trial of the content of the citizenship 
question. 

Q. But if you had conducted that RCT, you would have had the 
data that would have allowed you to isolate the effect of a 
citizenship question in the context of the decennial census 
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enumeration questionnaire, correct? 

A. So you haven't shown me the RCT we're talking about, but 
I'll assume it is the one we've talked about several other 
occasions. 

That RCT did have a treatment and control that would have 
isolated the effect of the citizenship question by itself on 
self-response, yes. 

Q. We'll get back to that in a minute. Dr. Abowd. 

I just want to ask you, even in response of that RCT, you 
agree that the Census Bureau can use the results of its 
analysis of the natural experiment to draw conclusions about 
the effect of a citizenship question on the 2020 census, 
correct? 

A. You're using the results of the natural experiment to do 
planning for the 2020 census based on its quantitative 
implications, yes. 

Q. You believe that the results from your natural experiment 
are sufficiently reliable for the census Bureau to make 
decisions planning for the 2020 census, correct? 

A. We believe they are the best available data, correct. 

Q. Dr. Abowd, you agree that the macro environment can affect 
response rates? 

A. Yes. 

Q. Part of the macro environment is the political context, 
right? 
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A. Yes, it is. 

Q. So the political context can affect response rates, 
correct? 

A. Yes, it can. 

Q. You agree that the political environment around immigration 
could amplify the effect of a citizenship question on response 
rates in comparison to, say, 2010, correct? 

A. Yes, it could. 

Q. And it could do that in comparison to, say, 2016, correct? 
A. Yes, it could. 

Q. You know, the last time there was an inquiry of the 
citizenship status of every member of every household in the 
United States was 1950, correct? 

A. Yes, that's correct. 

Q. You would agree that the macro environment is a little 
different now, right. Dr. Abowd? 

A. Well, I'm not a macro economist, but I think it is, yes. 

Q. I want to ask you about CBAMs research. Dr. Abowd. 

CBAMs stands for census barriers, attitudes, and 
Motivator studies, correct? 

A. Excuse me. Yes, it is. 

Q. The CBAMs research, that tells you a little something about 
the macro environment, right? 

A. That is what it was designed to do, yes. 

Q. OK. CBAMs consists of a survey of 50,000 households in a 
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series of more than 40 focus groups, correct? 

A. 42 focus groups. 

Q. The primary reason for conducting CBAMs is to inform the 
integrated partnership and communication program for the 2020 
census, correct? 

A. Yes, that's correct. 

Q. The Census Bureau finds that the CBAMs research that you do 
is sufficiently reliable as to provide actionable information 
that informs the communication and partnership campaigns 
conducted by the Census Bureau predicting, correct? 

A. Yes, that's correct. 

Q. Lets look at Plaintiffs' Exhibit 163. I believe this has 
been admitted into the record. 

Dr. Abowd, this is a PowerPoint summarizing rising 
information from the 2018 CBAMs focus groups, correct? 

A. I am only pausing because I am not sure it is exclusively 
the focus groups, but it is about the CBAMs research. 

Q. This PowerPoint was created by Young & Rubicam at the 
direction of the Census Bureau, correct? 

A. Young & Rubicam is the prime contractor on the integrated 
communication contract. It is working with a team of internal 
Census Bureau specialists. They jointly prepared this 
PowerPoint labeled with both logos, I believe. 

Q. This PowerPoint was presented to Under Secretary Kelley and 
to Secretary Ross, correct? 
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A. I believe I testified at deposition that I believe that is 
correct, but I wasn't at either of those — I wasn't at the 
presentation of the Under Secretary, so I'm not sure whether 
this is exactly the same one that she saw and the Secretary 
saw. I believe the content was very similar, but that is what 
I know. 

Q. You were in the room when this was presented to Secretary 
Ross ? 

A. I was in the room when a similar presentation was made to 
Secretary Ross that had a different date on it. 

Q. But it was materially identical to the PowerPoint here 
before you, correct? 

A. Yes, that's right. 

Q. You're not aware of any revised or more recent versions of 
this PowerPoint? 

A. No, I'm not. 

Q. Lets turn -- 

A. Actually, excuse me, I haven't compared this PowerPoint to 
the recent presentation to the National Advisory Committee, so 
I think, absent that comparison, I didn't notice any big 
differences. They give a more comprehensive version than what 
I remember being presented to the Secretary, but I don't think 
that the general conclusions or even a lot of the specific 
conclusions are very different. 

Q. We'll go over that PowerPoint too. Dr. Abowd. 
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Lets stick with this one for now. 

A. All right. 

Q. And look at page five, which I believe is page six of the 
PDF. So the next page. Thank you. 

The title of this slide is Distrust in Census and 
Government May Complicate Outreach to Some Communities, 
correct? 

A. Yes, it is. 

Q. OK. The second bullet from the bottom reads: A number of 
focus group participants responded negatively to adding the 
citizenship question, most notably Spanish (U.S. mainland) as 
well as Vietnamese, Chinese, NHPI, and members of the female 
MENA group. 

Did I read that right? 

A. Yes, you did. 

Q. Now, most of these focus groups were conducted after the 
announcement of a citizenship question to be included in the 
census, correct? 

A. 30 of 42, yes. 

Q. And people recruited into the focus groups referenced in 
that bullet that we just discussed, they mentioned the 
citizenship question as a barrier to census participation, 
correct? 

A. Yes, that's correct. 

Q. This bullet in this PowerPoint was included to draw the 
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attention of the people for whom the PowerPoint was intended, 
correct? 

A. Would you mind restating that question? I couldn't unpack 
it. 

Q. Sure. 

This bullet, starting with the number of focus group 
participants, that was included in this PowerPoint in order to 
draw the attention of the people for whom the PowerPoint is 
intended, right. Dr. Abowd? 

MR. EHRLICH: Objection. 

THE COURT: Sustained. 

Q. Dr. Abowd, why was this bullet included in the PowerPoint? 
A. The PowerPoint was prepared, as I understand it, to inform 
the Under Secretary. 

Q. But why was this particular bullet included in the 
PowerPoint? 

A. It summarizes one of the conclusions of the CBAMs focus 
group studies. 

Q. Dr. Abowd, do you remember your third deposition in this 
case which occurred on October 5, 2018? 

A. Yes. 

Q. You were under oath that day, right? 

A. Yes, I was. 

Q. And you told the truth that day, right? 

A. Yes, I did. 
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Q. OK. Lets bring that up and look at page four 43, starting 
with line five. 

"Q. And why was this bullet included in the PowerPoint? 

"A. I believe to draw the attention of people who are using 
this to — that finding of the focus groups. 

Q. Was that my question — was that the question that was 
posed to you and your answer that day. Dr. Abowd? 

A. Yes, it was. 

Q. OK. And during the presentation of this PowerPoint to 
Secretary Ross, it was acknowledged that the citizenship 
question would be a challenge in conducting the 2020 census, 
correct? 

A. Yes, it was. 

Q. OK. Lets bring up Plaintiffs' Exhibit 152 now. This has 
also been admitted into the trial record. 

Dr. Abowd, this is the 2020 CBAMs focus group audience 
summary reports, correct? 

A. Yes, that's what they are. 

Q. You've seen this document before, right? 

A. Yes, I have. 

Q. Lets go to page 22 of this document, which is Bates number 
13046. 

This is part of the summary for focus groups 
consisting of participants who are U.S. mainland residents who 
speak Spanish, correct? 
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I believe that is at the top of the page. 

A. This is the top of the page you said who speaks Spanish. I 
know there was both a Spanish-speaking Spanish and an 
English-speaking Spanish, so I'm not sure whether this 
particular page is both or one. 

Q. When you say Spanish U.S. mainland, what does that refer 
to? 

A. It means that the people recruited for this focus group 
were Hispanic origin and living in the U.S. mainland. 

Q. Lets look at the third bolded paragraph on this summary. 

The title or the first sentence is the citizenship question 
is a determining factor for participation, correct? 

A. Yes. 

Q. It reads: All four Spanish, U.S. mainland focus groups 
took place after the March 27, 2018, announcement that the 2020 
census will include a question on citizenship, correct? 

A. Yes. 

Q. And Spanish means Hispanic, Dr. Abowd, in that sentence? 

A. I believe so, yes. 

Q. OK. It goes on to read: Participants in all locations 
mentioned the citizenship question before the moderator asked 
about it, except for Houston group one participants, correct? 

A. Yes. 

Q. And it goes on to read: Most participants said that though 
they personally are citizens or legal residents and are not 
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afraid to answer the citizenship question, they know many 
others who will not fill out the question or the form 
altogether out of fear. While all participants expressed the 
desire to be counted, fear of deportation outweighs any 
benefit. 

Did I read that right? 

A. Yes, you did. 

Q. Dr. Abowd, you agree that this focus group result is an 
indication from a hard-to-count population that the citizenship 
question viewed as extremely problematic for that population, 
correct? 

A. It is an indicator of that, yes. 

Q. And you acknowledge that with the citizenship question on 
the census, people who are afraid of deportation will be an 
extremely difficult group to count, correct? 

A. They will be a very difficult group to count. 

Q. Extremely, right. Dr. Abowd? 

A. So I suppose we can discuss what the difference between 
"very" and 'extremely' is. 

Q. In your words. Dr. Abowd, you would describe people, who 
are fearing deportation, as extremely hard to count in the 2020 
census, when you put a citizenship question on it, correct? 

A. So very hard to get to self-respond. Whether they are hard 
to count or not depends on other operations in the 2020 census. 
Q. All right. Dr. Abowd, lets go back to your October 5, 2018 
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deposition, page 451, line three. 

MR. EHRLICH: Your Honor, I would note that the 
deposition testimony we're using here is his 30(b)(6) testimony 
in his capacity as a representative of the Census Bureau, and 
would object on that basis, to the extent it is asking him for 
personal knowledge that he may have. 

THE COURT: Mr. Ho, that seems well founded. 

MR. HO: I mean, he is testifying as a representative 
of the Census Bureau under the 30(b)(6), but, I mean, he uses 
the first person quite frequently in the deposition and 
expresses his understanding of events in his capacity as the 
chief scientist of the Census Bureau. I don't think there is 
any reason that I can't use his deposition testimony to impeach 
him on that basis. 

MR. EHRLICH: His first person use was for ease of 
reference during the deposition, your Honor. You can't draw 
from this personal knowledge of what he may or may not know 
based on what the agency knows and what he testified on behalf 
of the agency. 

THE COURT: All right. Tell you what. You'll have an 
opportunity to conduct cross-examination. 

I think in that context, you can elicit from him the 
extent to which this testimony, if it is being offered as an 
inconsistent statement, is actually not his personal statement 
as opposed to his representative statement. 
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With that, you may proceed, Mr. Ho. 

MR. HO: Thank you, your Honor. 

BY MR. HO: 

Q. Page 451, line three. 

"Q. And aren't people afraid of deportation the least likely 
to participate at all in the census or to be swayed by NRFU 
efforts ? 

"A. I'm not prepared to say the least likely to participate at 
all. I'm tried to acknowledge that they're an extremely 
difficult group to count. 

Q. Was that the question posed to you and was that your 
answer? 

A. Yes, it was. 

Q. Now, going back to the focus group summary, page 22 of it. 
It indicated here that Hispanic focus group members, that 
members of their community care about participation in the 
census, correct? 

A. Yes. 

Q. They express that they understood the benefits to their 
community of participating in the census, correct? 

A. Yes, they did. 

Q. And, Dr. Abowd, it is reasonable to conclude that they 
would like to participate in the census, correct? 

A. That seems reasonable, yes. 

Q. And what you get from this focus group is an indication 
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that members of this group would be more likely to self-respond 
if there was not a citizenship question on the 2020 census, 
correct? 

A. Yes. 

Q. I'm sorry? 

A. Yes. 

Sorry. Am I fading? 

Q. Thank you. 

This also indicates that if there is a citizenship question 
on the census, that trusted partners who try to carry forth the 
Census Bureau's message are going to have additional challenges 
in convincing members of this community to participate, 
correct? 

A. I don't think you called out those sentences, but I assume 
they're in there. 

Q. But you agree with that, right. Dr. Abowd, that given the 
results of this focus group, that you would conclude that the 
trusted partners that the Census Bureau relies on to carry 
forth the message that it is important to participate in the 
census, that they are going to have additional challenges 
carrying that message out than if there were no citizenship 
question on the census, correct? 

A. Yes. 

Q. I want to ask about a different document now, a different 
PowerPoint I think you referred to earlier why. 
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This is Plaintiffs' Exhibit 662, entitled 2020 Census 
Barriers, Attitudes, and Motivators study (CBAMs) Survey and 
Focus Groups: Key Findings for Creative Strategy. October 31, 
2018. 

For the record, it has been admitted. 

This is the PowerPoint that you were talking about earlier 
which includes both CBAMs survey results and focus group 
information, right. Dr. Abowd? 

A. That's correct. 

Q. Lets go to page 16 of the PowerPoint. It is page 16 of the 
PowerPoint, but 17 of the PDF. 

This slide has some results of the CBAMs survey, correct? 

A. Yes, it does. 

Q. The fifth line here indicates that: 10 percent of 
respondents to the CBAMs survey think that the census is used 
to locate people living in the country without documentation, 
right? 

A. Yes. 

Q. And 37 percent aren't sure one way or the other whether or 
not that is the case, correct? 

A. That's correct. 

Q. All right. Lets turn to page 19 of the PowerPoint, which 
is page 20 of the PDF. 

Dr. Abowd, this slide indicates that 19 percent of Asian 
and black CBAMs survey respondents think that the census is 
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used to locate people without documentation, correct? 

A. Yes. 

Q. Lets turn to the next page of the PowerPoint. 

This slide summarizes some comments from Hispanic CBAMs 
focus group participants, correct? 

A. Yes. 

Q. And one Hispanic focus group participant said, I feel that 
it does go to the immigration agency, in regard to census 
responses, correct? 

A. I think you're calling out the first quote there? 

Yes . 

Q. Yes. 

Another Hispanic focus group participant said that 
they would not participate in the census because they — 
meaning immigration — will know where we are and what our 
names are and where we live, correct? 

A. That's what the quote says, yes. 

Q. And another Hispanic focus group participant stated, I 
feel — I'm sorry — stated a concern that immigration 
enforcement, quote, will know where we are and what our names 
are and where we live, correct? 

I'm sorry. I already did that one. 

Lets look at page 29 of the PowerPoint, slide 30. 

This has results from the CBAMs survey, correct? 

A. Yes. 
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Q. The title of the slide is Respondents Worry About 
Confidentiality, correct? 

A. That's correct. 

Q. Specifically, 41 percent of Asians CBAMs survey respondents 
expressed worry about confidentiality, correct? 

A. Yes, that is correct. 

Q. And so did 41 percent of low English proficiency CBAMs 
survey respondents, correct? 

A. Yes. 

Q. Great. Lets turn to page 31 of the PowerPoint. 

This had some results about concerns about data sharing of 
census responses, correct? 

A. Yes. 

Q. 37 percent of low English proficiency CBAMs respondents 
expressed concern about data sharing, right? 

A. Yes. 

Q. 36 percent of CBAMs respondents who responded in Spanish 
did too, correct? 

A. Yes. 

Q. And 32 percent of CBAMS respondents born outside of the 
United States did as well, correct? 

A. Yes. 

Q. And 32 percent of Hispanics overall believe that the census 
shares data with other agencies, correct? 

A. Concerned about the census sharing data, correct. 
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Q. Thank you. 

Can we turn to page 35. According to this slide, one in 
four CBAMS survey respondents fear that their answers to the 
2020 census will be used against them, correct? 

A. Yes. 

Q. And that's true for 41 percent of Asian CBAMs respondents, 
correct? 

A. Yes. 

Q. And true of 39 percent of CBAMs respondents born outside of 
the United States, correct? 

A. Yes. 

Q. And 34 percent of CBAMs respondents who responded in 
Spanish, correct? 

A. Yes. 

Q. Lets turn to page 42 of the PowerPoint. Page 43 of the 
PDF . 

The title of this slide is The Citizenship Question 
May Be a Major Barrier, correct? 

A. Yes, that is the title. 

Q. And focus group participants expressed concern that the 
purpose of the question is to find undocumented immigrants, 
correct? 

A. The call-outs in red up at the top? 

Q. Yes. 

A. Yes, that's correct. 
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Q. And there also was an indication from focus group 
participants that there is a concern due to the political 
discourse that we currently have, correct? 

A. Yes, that is what it says. 

Q. OK. In the bottom left-hand corner, there is a Hispanic 
focus group participant who stated, A lot of people are afraid. 
It doesn't matter if they ask you whether or not you're a 
citizen. The first question they ask you, are you Hispanic or 
Latino? And that's enough. That's all they need and people 
are scared. 

Do you see that? 

A. Yes, I do. 

Q. Do you see the one on the right that reads: Latinos will 
not participate out of fear. There was practically a hunt for 
us. Latinos are going to be afraid to be counted because of 
the retaliation that could happen. It's like giving the 
government information saying, oh, there are more here. 

Correct? 

A. That is what the quote says, correct. 

Q. Lets turn to page 57 of the PowerPoint. Page 58 of the 
PDF . 

This is a summary of Hispanics participating in the 
CBAMS research, correct? 

A. Yes. 

Q. So among Hispanics, 10 percent believe that the census is 
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used to locate people living in the country without 
documentation, correct? 

A. That's not on this slide, I don't think, but you already 
showed it to me. That — there it is. Yes, correct. 

Q. And 34 percent express concern about the confidentiality of 
their answers, correct? 

A. Correct. 

Q. 32 percent express concern that their answers will be 
shared with other government agency, correct? 

A. Correct. 

Q. 33 percent express fear of repercussions from their census 
answers, correct? 

A. Correct. 

Q. The bullet under other considerations reads, focus group 
participants expressed intense fear that information will be 
shared with other government agency to help them find 
undocumented immigrants. Participants worried that their 
participation in the census could harm them personally or 
others in their communities/households they care about, 
correct? 

A. Yes, that is what it says. 

Q. That is Hispanic focus group participants, correct? 

A. Correct. 

Q. Now, Dr. Abowd, overall, you would describe this focus 
group research as qualitative research, correct? 
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A. That's correct. 

Q. And all of the CBAMS focus group research that we have 
discussed happened in 2017 and '18, correct? 

A. I think it all happened in 2018. 

Q. All happened in 2018? 

A. Yes. 

Q. OK. You agree. Dr. Abowd, that the CBAMS focus group 
research conducted by the Census Bureau suggests a greater 
sensitivity to a citizenship question today than there was a 
few years ago, correct? 

A. The CBAMS research, both the focus group and the survey, 
have alerted us to what we consider a major difficulty in 
fielding the 2020 census to regain the trust of the Hispanic 
community, yes. 

Q. The research suggests that the macro environment today, 
which affects the sensitivity of citizenship questions on 
Census Bureau surveys, is different than it was a few years 
ago, correct. Dr. Abowd? 

A. So the research that you just showed me doesn't support an 
inference of change, so I won't make one. 

But it does support that it is a major concern now, whether 
it is greater or less than it was for the 2010 census. It 
wasn't supported by what you said, but it does support that it 
is a major concern now. 

Q. Dr. Abowd, the sensitivity to a citizenship question that's 
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reflected in the 2018 CBAMS research, that degree of 
sensitivity would not be captured in the 5.8 percentage point 
estimate that is based on data only up through 2016, correct? 

A. It is — yes, that is right. 

Q. Dr. Abowd, you're aware that there are recent news reports 
that President Trump is contemplating an executive order that 
provide that citizenship will no longer be conferred on all 
persons born on United States soil? 

A. I have read the news reports, yes. 

Q. Dr. Abowd, you would agree that that is something that 
could affect the macro environment around the census, correct? 
A. Yes. 

Q. You're aware that on November 2 of this year, the Census 
Bureau's National Advisory Committee on racial, ethnic, and 
other populations, recommended that the Census Bureau evaluate 
and report on the potential effects of such an order on census 
operations for 2020, correct? 

A. So I was called to litigation on the day the 
recommendations were read out loud. I assume you're quoting 
them right, but I wasn't there, and they haven't been delivered 
to my inbox yet. 

Q. But you're aware of that recommendation, right. Dr. Abowd? 
A. You just made me aware of it, yes. 

Q. The Census Bureau has not conducted any analysis that 
you're aware of about how the macro environment may have 
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changed in light of that announcement of the executive order 
that President Trump is contemplating, correct? 

A. That's correct. 

THE COURT: Mr. Ho, would this be a good time to take 
our lunch break? 

MR. HO: Sure. 

THE COURT: All right. Question. We're technically 
on direct, but in some respects, this is more properly viewed 
as cross. 

Does anyone have a view on whether Dr. Abowd should be 
permitted to speak with defense counsel during the break? 

MR. HO: Our view, your Honor, is that he should not 
be permitted to because it is like a cross. It is an adverse 
direct like a cross-examination, so we think he should be 
sequestered from speaking about the substantive subject of the 
litigation while he remains on the stand. 

THE COURT: Mr. Ehrlich, any objection to my so 
instructing Dr. Abowd? 

MR. EHRLICH: No objection, your Honor. 

THE COURT: Dr. Abowd, because you're on what is 
functional equivalent of cross-examination, the rules dictate 
that you shouldn't speak with defense counsel concerning the 
substance of your testimony. 

If you have logistical conversation with them or the 
like, that is fine, but please don't speak about the substance 
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of your testimony. And if it would be easier not to speak with 
them at all, don't speak with them at all. 

It is 1:01. We'll pick up again at 2:00 p.m. 

Enjoy your break. Thank you. 

(Luncheon recess) 
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AFTERNOON SESSION 
2:00 p.m. 

THE COURT: You may be seated. 

Apologies for a slightly late start. Something came 
up that I needed to deal with. 

We will continue with the direct examination. 

Dr. Abowd, I remind you that you are under oath. 

Mr. Ho, you may proceed. 

MR. HO: Thank you, your Honor. 

Q. Dr. Abowd, I just wanted to go back to a couple of exhibits 
that we talked about before the lunch break briefly before we 
move on. 

MR. HO: I'd like to go back to Plaintiffs' Exhibit 4, 
which is a portion of the administrative record in this case. 
This is page 7,913 of this exhibit, AR No. 11634. This is a 
document in the administrative record that's been admitted into 
evidence. 

Q. Dr. Abowd, is this an earlier draft version of the Brown et 
al. memo that we were discussing earlier? 

A. Yes, it is. 

Q. It's dated December 22, 2017? 

A. Yes, it is. 

Q. And it's in the administrative record in this case? 

A. Yes, it is. 

Q. And this draft contains earlier versions of the same 
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analyses of ACS data, unit nonresponse, item nonresponse, etc., 
that we discussed earlier? 

A. Contains many of the analyses we discussed earlier, yes. 

Q. Thank you. 

I want to talk about, briefly. Plaintiffs' Exhibit 448. 

This is a different PowerPoint, one given to the national 
advisory committee on racial, ethnic and other populations. Do 
you see that. Dr. Abowd? 

A. Yes, I do. 

MR. HO: This has been admitted into the record. I'd 
like you to look at page 13 of this document, and the third 
bullet. 

Q. That's a quote from an interviewer from the CBAMS work, 
right? 

A. It's a quote from an interviewer during field studies that 
the center for survey methods — survey measurement was 
conducting before this report was written. 

Q. Sorry. My apologies. Thank you for that correction. 

Dr. Abowd. 

The interviewer from the Census Bureau stated: "Three 
years ago was so much easier to get respondents compared to now 
because of the government changes and trust factors. Three 
years ago I didn't have problems with the immigration 
questions." Did I read that correctly? 

A. Yes, you did. 
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Q. And that's some qualitative evidence suggesting that 
questions related to immigration status asked by the Census 
Bureau have a greater sensitivity today than they did a few 
years ago, correct? 

A. Yes, it is. 

MR. HO: Dr. Abowd, I want to go back to your January 
memo to Secretary Ross, Plaintiffs' Exhibit 22, and I want to 
ask you about a passage on page 5 under the header B4, cost 
estimates. 

Q. Dr. Abowd, the lower self-response rates resulting from the 
addition of a citizenship question to the 2020 census, you 
would expect would increase the cost of conducting the 2020 
census, correct? 

A. That's correct. 

Q. And the reason why that is is that when you have lower 
self-response rates, you have to try to enumerate more people 
through nonresponse follow-up efforts, or NRFU, correct? 

A. That's correct. 

Q. And NRFU costs money, right? 

A. Yes, it does. 

Q. Part of the NRFU process includes sending Census Bureau 
enumerators in person to nonresponding households, correct? 

A. That's correct. 

MR. HO: Let's turn to page 6 of your memo and the 
second-to-last paragraph, if we could blow it up. 
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Q. This paragraph describes the cost estimates that you 
presented in this memo for the estimated cost of including the 
citizenship question on the 2020 census, correct? 

A. That's correct. 

Q. And in this memo, you estimated that the inclusion of the 
question could increase NRFU costs by at least $27.5 million, 
correct? 

A. Yes, that's correct. 

MR. HO: And if we could blow up the last paragraph on 
this page. 

Q. Dr. Abowd, as you presented your findings in this memo, you 
describe the $27.5 million estimate as a conservative estimate, 
is that correct? 

A. That's correct. 

Q. And one reason why it's a conservative estimate is because 
the differences in self-response rates to the 2020 census 
between citizen and noncitizen households may be even greater 
than estimated in this memo, correct? 

A. That's correct. 

Q. And so, the memo describes the $27.5 million cost as a 
lower-bound estimate, correct? 

A. Yes, that's correct. 

Q. Now, one reason why you describe it as a lower-bound 
estimate in your memo is that the estimate assumes that — 
well, strike that. 
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MR. HO: Let me try that again. 

Q. One reason why you describe this as a lower-bound estimate 
in your memo is that it may take more NRFU visits to enumerate 
households that don't respond to the citizenship question than 
you assumed in generating the $27.5 million estimate, correct? 
A. That's one of the reasons, yes. 

Q. And another reason is that this lower-bound cost estimate 
does not incorporate any estimate about the effect of a 
citizenship question on reducing self-response rates from all 
citizen households, correct? 

A. That's correct. 

Q. And another reason why this estimate is conservative and a 
lower-bound estimate is that it does not capture increased 
communication campaign costs that may be needed as a result of 
the citizenship question, correct? 

A. That's correct. 

MR. HO: I want to bring us back to page 1 of the 
memo, and I just want to look at the last sentence on page 1. 

Q. Given everything that we've described. Dr. Abowd, your memo 
describes adding a citizenship question to the 2020 census as 
very costly, correct? 

A. Correct. 

Q. Now, the lower self-response rates resulting from the 
addition of the citizenship question will also reduce the 
quality of the data resulting from the 2020 census, correct? 
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A. That's correct. 

Q. And one reason for that is that when you get lower 
self-response rates, you have to try to enumerate people 
through NRFU efforts like proxies, correct? 

A. That's correct. 

Q. And generally speaking, when you do nonresponse follow-up, 
you don't get answers that are as reliable as when you get 
self-responses, correct? 

A. By the coverage error measures that we use, that's correct, 
yes. 

Q. Your memo, in this same last sentence on the first page, 
concludes that adding a citizenship question to the census 
would harm the quality of the census count, correct? 

A. That's correct. 

Q. And that applies to both alternatives B and option D, which 
Secretary Ross ultimately chose, correct? 

A. That's correct. 

Q. Dr. Abowd, harming the quality of the census data, that's a 
bad thing, right? 

A. Something we try to avoid, yes. 

Q. I'd like to ask you about different data quality issue with 
respect to the citizenship question. Dr. Abowd, you agree — 

I'm sorry. 

MR. HO: Let me start that again. 

Q. Dr. Abowd, sometimes it happens that there's disagreement 
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between a person's citizenship status as reflected in 
administrative records and what that person reports or what's 
reported for that person in response to the citizenship 
question on the American Community Survey, correct? 

A. That's correct. 

Q. So sometimes administrative records indicate that someone 
is a noncitizen but the ACS response indicates that that 
person's a citizen, right? 

A. Yes, that's correct. 

Q. And in your memo. Plaintiffs' Exhibit 22, you describe 
citizenship status as reflected in the administrative records 
as "verified," correct; that's the term you use? 

A. Yes, that's the term we use. 

Q. And the reason you use the term "verified" is because the 
person's citizenship status as reflected in administrative 
records is based upon a legal document indicating that person's 
citizenship status, correct? 

A. That's correct. 

Q. Now, by contrast, someone's citizenship status as reported 
in response to the ACS citizenship question is based on a 
survey response, not a legal document, correct? 

A. That's correct. 

Q. And so, you would describe that person's citizenship status 
as referred to — as reported, I'm sorry, in the ACS as 
unverified, correct? 
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A. Or a survey response, yes. 

Q. Now, you agree. Dr. Abowd, that if someone is coded in 
administrative records as a noncitizen, then it's reasonable to 
conclude that that person is, in fact, a noncitizen, correct? 

A. At the time at which the coding was done, yes. 

Q. And you believe that when someone's ACS response says that 
they are a citizen but the administrative records says that 
they're not a citizen, then the most likely conclusion is that 
the person is, in fact, a noncitizen, correct? 

A. The survey response was citizen and the administrative 
record response was noncitizen? 

Q. Yes. 

A. Correct, insofar as the administrative record is 
contemporaneous with the survey response, yes. 

Q. If all you have is an administrative record and all you 
have is a survey response, the administrative record says 
noncitizen, survey response says citizen, then you'd agree that 
it's more likely than not that that person's a noncitizen, 
right? 

A. That's correct. 

Q. So, Dr. Abowd, is it correct to say that citizenship status 
is one characteristic where you believe that administrative 
records tend to be more accurate than survey responses? 

A. Yes, that's correct. 

MR. HO: Let's bring back up Plaintiffs' Exhibit 22, 
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your January memo, page 8. I want to look at the second full 
paragraph. 

Q. Now, according to your memo, in the 2016 ACS, individuals 
whom the administrative records indicate are noncitizens 
responded "citizen" 34.7 percent of the time on the ACS 
citizenship question, correct? 

A. Did you say 2016; that's the number you read? 

Q. Yes. 

A. Yes. 

Q. And overall, in the Census Bureau's research on this issue, 
you've determined that for people for whom the administrative 
records indicate that they're noncitizens, there's disagreement 
between the administrative record and the ACS survey response 
between 30 to 37 percent of the time, correct? 

A. That's correct. 

Q. And you'd agree, then, given what we discussed earlier, 
that it's likely that for more than 30 percent of noncitizens 
who provide a response to the ACS citizenship question, the 
response is incorrect, right? 

A. Response is in disagreement with the administrative record 
and probably incorrect. 

Q. Now, the Census Bureau has no empirical basis to believe 
that noncitizens for whom a response is provided to a 
citizenship question on the census will have more accurate 
responses than they do to the citizenship question on the ACS, 
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correct? 

A. That's correct. 

Q. And in fact. Dr. Abowd, the Census Bureau believes that 
there are definitely indications that responses by noncitizens 
to a citizenship question on the 2020 census will be even less 
accurate than they have historically been on the ACS, correct? 
A. That's correct. 

Q. The Census Bureau still hasn't made any determination about 
how it will address disagreement between survey responses and 
the administrative records when producing block-level CVAP data 
for the Department of Justice after the 2020 census, correct? 

A. For a public-use tabulation that will be used by the 
Department of Justice, that's correct. 

Q. Now, alternative C, Dr. Abowd, is to use administrative 
data and no citizenship question to collect citizenship data 
and then to rely principally on that administrative data to 
produce block-level CVAP data for the Department of Justice, 
correct? 

A. That's correct. 

Q. And under alternative C, you would take responses to the 
census questionnaire and then link those responses to 
administrative data with citizenship information in it, 
correct? 

A. That's correct. 

Q. And the particular administrative records that you would 
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use under alternative C are the social security numerical 
identification system, or Numident, data, correct? 

A. I've never heard the acronym expanded, but yes, Numident is 
the correct file. 

MR. HO: Let's bring your memo back up. Plaintiffs' 
Exhibit 22. I want to look at the first page, the last 
paragraph, second sentence. 

Q. Dr. Abowd, the conclusion that you reached in your memo is 
that unlike including a citizenship question, using 
administrative records to provide DOJ with block-level CVAP 
data would not harm the quality of the census count, correct? 

A. As long as it's done without simultaneously asking the 
question on the census, yes. 

Q. And if you just used the administrative records, you didn't 
ask the citizenship question, under alternative C, you would 
have to deal with a problem of survey responses and 
administrative records that disagree, correct? 

A. Correct. 

Q. And so, the Census Bureau concluded that using 
administrative records would deliver higher quality block-level 
CVAP data by race and ethnicity than including a citizenship 
question on the census, correct? 

A. Yes. 

Q. The Census Bureau's proposal to generate such block-level 
CVAP data using administrative records rather than a 
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citizenship question had the backing of the Census Bureau's 
redistricting office, correct? 

A. Yes, it did. 

Q. Now, this memo also concludes that using administrative 
records would be far less costly than including a citizenship 
question on the 2020 census, correct? 

A. That's correct. 

Q. And part of the reason is that if you use administrative 
records but you don't include a citizenship question on the 
census, you don't have increased NRFU costs, correct? 

A. That's correct. 

Q. And the conclusion of the Census Bureau that was reached in 
this memo is that using administrative records and not 
including a citizenship question on the census would best meet 
DOJ's stated uses, correct? 

A. That's correct. 

Q. And you communicated that conclusion to Secretary Ross 
during your meeting with him on February 12, 2018, correct? 

A. Yes, we did. 

Q. Now, the Census Bureau, during this period of time, also 
offered to meet with the Department of Justice to discuss its 
recommendations, correct? 

A. That's correct. 

Q. The analyses that we've been discussing, those began after 
Arthur Gary — or after a letter signed by Arthur Gary from the 
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Department of Justice was sent to the Census Bureau requesting 
a citizenship question on December 12, correct? 

A. We got it on December 15, but that's correct, yes. 

Q. And you're aware that Acting Census Bureau Director Ron 
Jarmin subsequently wrote an email to Arthur Gary, correct? 

A. Yes, I'm aware of that email. 

MR. HO: OK. Let's bring up Plaintiffs' Exhibit 109. 
This is in the administrative record and has been admitted into 
evidence. 

Q. Dr. Abowd, this is the email that we discussed from Acting 
Census Bureau Director Ron Jarmin to Arthur Gary at the 
Department of Justice, correct? 

A. That's correct. 

Q. And the top email on this thread is Acting Director Jarmin 
forwarding to you and someone else the email that he had 
written to Arthur Gary, correct? 

A. That's correct. 

MR. HO: Let's look at the email that Acting Director 
Jarmin forwarded to you, the one that he wrote to Mr. Gary. 
Acting Director Jarmin wrote to Mr. Gary on December 22: 

"Thank you for your letter dated 12/12/2017 regarding 
improving the quality of citizenship information for DOJ 
enforcement of the Voting Rights Act. Let me start by saying 
the bureau is fully supportive of providing DOJ with the 
highest quality statistical information possible. To that end 
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I've directed staff to review all possible ways to address the 
means expressed in the letter." 

Q. Did I read that correctly? 

A. Yes, you did. 

Q. Dr. Abowd, when Acting Director Jarmin wrote this email, 
you understand him to be making — you understand him to be 
referring to the analysis that you were working on with the 
SWAT team, correct? 

A. That's correct. 

Q. This email, dated February 22, 2017, that's the same date 
as the draft version of the Brown et al. memo in the 
administrative record that we talked about, beginning after the 
lunch break, correct? 

A. That's correct. 

MR. HO: Now, the next two sentences of Acting 
Director Jarmin's email to Mr. Gary read: 

"They have now briefed me and their findings suggest 
that the best way to provide PL 94 block level data with 
citizen voting population by race and ethnicity would be 
through utilizing a linked file of administrative and survey 
data the Census Bureau already possesses. This would result in 
higher quality data produced at lower cost." 

Q. Did I read that right? 

A. Yes, you did. 

Q. When Acting Director Jarmin referred to a linked file of 
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administrative and survey data, your understanding is that's a 
reference to alternative C in your memo, creating a citizenship 
voting-age population table using administrative records, 
right? 

A. It is a reference to alternative C, but I believe he 
intended to also discuss with them whether they would like us 
to do it enhancing the American Community Survey or with some 
other survey basis. 

Q. And in his email to Mr. Gary, Acting Director Jarmin 
referred to this as the "best way" to provide block-level CVAP 
data to DOJ, correct? 

A. That's correct. 

Q. And Acting Director Jarmin, in his email to the Department 
of Justice, referred to this option of using administrative 
records as producing "higher quality data produced at lowest 
cost," right? 

A. That's correct. 

Q. The last sentence of Acting Director Jarmin's email to Mr. 
Gary at the Department of Justice says, "I suggest we schedule 
a meeting of census and DOJ technical experts to discuss the 
details of this proposal." 

You're aware that a meeting was tentatively scheduled 
between Mr. Gary and Acting Director Jarmin for mid-January, 
right. Dr. Abowd? 

A. I'm aware from the administrative record, yes. 
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Q. And you're aware that that meeting never took place, 
correct? 

A. That meeting never took place, that's correct. 

Q. And in fact. Dr. Abowd, the Department of Justice refused 
to take the meeting referenced here in this email for the 
purpose of discussing the Census Bureau's proposal to produce 
higher quality CVAP data at lower cost than adding a 
citizenship question to the census, correct? 

A. I don't know personally that the Department of Justice 
refused. I've read in the administrative record the same 
things that you have; it never happened. 

Q. And the reason it never happened is because DOJ leadership 
didn't want that meeting to take place, right. Dr. Abowd? 

MR. EHRLICH: Objection. 

THE COURT: Sustained. 

Q. Your understanding is that DOJ leadership didn't want that 
meeting to take place, right. Dr. Abowd? 

A. That is my understanding, yes. 

Q. Dr. Abowd, I'd like to show you some deposition testimony 
that has been designated as evidence in this case and ask you 
about your knowledge of it. 

MR. HO: With the Court's permission, your Honor, we'd 
like to play a very short clip of acting — Assistant Attorney 
General John Gore's deposition designations, which have been 
filed with the Court, which have been lodged with the Court and 
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filed publicly. 

THE COURT: Any objection? 

MR. EHRLICH: We don't see any need to do that, your 
Honor. He can ask Dr. Abowd his opinion and Dr. Abowd can give 
his opinion. I'm not sure why we need to watch a video clip, 
which your Honor said you would watch on your own time. 

THE COURT: And I've already watched on my own time, 
but that being said. I'll let Mr. Ho engage in his examination 
the way he would like if there's no basis to object. 

You may proceed. 

MR. HO: Thank you, your Honor. The clip is very 
short. It's from page 274 of Mr. Gore's deposition. The lines 
have been designated lines 5 through 9, and we'll try to play 
it now. 

(Video played) 

BY MR. HO: 

Q. Dr. Abowd, at the time the bureau was informed that the 
Department of Justice did not want to meet to discuss the 
Census Bureau's proposal for higher quality CVAP data at the 
lower cost, were you aware that the attorney general personally 
made that decision? 

A. I was not. 

Q. When did you become aware of that? 

A. When the administrative record revealed it. 

Q. Have you ever heard of another circumstance in which the 
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attorney general personally directed staff at the Department of 
Justice not to meet with the Census Bureau to discuss a 
proposal for higher quality data that the Department of Justice 
requested? 

A. I have not, no. 

Q. Are you aware of any other circumstance in which a cabinet 
secretary personally directed agency staff not to meet with the 
Census Bureau? 

A. I'm not aware of any circumstances, no. 

Q. Dr. Abowd, in your experience, is it unusual for the Census 
Bureau to receive a data request from an agency and then for 
that agency to refuse to meet with the Census Bureau to discuss 
the technical aspects of that data request? 

A. Yes, it is. 

Q. Now, sometime. Dr. Abowd, after your meeting with Secretary 
Ross on February 12, you were asked to consider a fourth 
alternative, which we've been referring to as option D or 
alternative D. Is that correct? 

A. That's correct. 

Q. Just so we're clear, alternative D combines both 
alternatives B and C; that is, you both add a citizenship 
question to the census and you look at administrative records 
on citizenship under alternative D, correct? 

A. That's correct. 

Q. And your understanding was that after that February 12 
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meeting. Secretary Ross and Undersecretary Kelley wanted you to 
work on alternative D, correct? 

A. To evaluate it, yes, that's correct. 

Q. And Acting Director Jarmin told you that, right? 

A. Yes, he did. 

MR. HO: I want to look at Plaintiffs' Exhibit 25. 

This is admitted into the trial record as a part of the 
administrative record. 

Q. Dr. Abowd, this is a memo under your name assessing 
alternative D, correct? 

A. That's correct. 

I want to note the watermark isn't on this page again, but 
it is the administrative record. 

Q. I think it has something to do with the screen. I 
apologize for that. 

But this is the version, 1.0, of the draft memo that you 
prepared at the request of Acting Director Jarmin on the 
subject of alternative D, right. Dr. Abowd? 

A. That's correct. 

Q. And it was directed through Acting Director Jarmin to the 
undersecretary and to the secretary of commerce, correct? 

A. That's correct. 

Q. And the views expressed in this memo are those of the 
senior executive straff at the Census Bureau, correct? 

A. That's correct. 
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Q. And you're not aware of any subsequent versions of this 
memo, correct? 

A. I am not. 

MR. HO: Let's turn to page 5 of this memo, which is 
administrative record page 1312. 

Q. The final paragraph sets forth the conclusion of the Census 
Bureau about alternative D in comparison to alternative C, 
correct? 

A. Yes, it does. 

Q. And you concluded that alternative D would result in poorer 
quality citizenship data than alternative C; it would still 
have all the negative cost and quality implications of 
alternative B outlined in the draft January 19, 2018, memo to 
the Department of Commerce, correct? 

A. That's correct. 

Q. And so, the Census Bureau did not recommend alternative D, 
correct? 

A. That was also correct. 

Q. And the Census Bureau still does not recommend alternative 
D, correct? 

A. That's correct. 

Q. But Secretary Ross selected alternative D anyway, correct? 
A. The secretary instructed us to do alternative D, that's 
correct. 

MR. HO: Now, I want to ask you about overall census 
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data quality under C and D. And let's look at page 4 of this 
memo, the last full paragraph. I want to highlight the third 
sentence, beginning with "however," about five lines down. 

Q. Now, your March memo here notes that because alternative D 
involves adding a citizenship question to the census, the 
Census Bureau expects to see the same reduction in 
self-response rates that you would see under alternative B, 
correct? 

A. That's correct. 

MR. HO: I want to ask you about the next sentence, 
starting with "not only." 

Q. Your memo notes that the reduction in response rates, under 
alternative D, would lead to more enumerations through the NRFU 
process and more incorrect enumerations than you'd have under 
alternative C, correct? 

A. Yes. 

MR. HO: And then let's highlight the next sentence, 
starting with "in the 2010 decennial census." 

Q. The memo notes that the increased number of enumerations 
through the NRFU process under alternative D will produce lower 
quality personal data on the census responses as compared to 
alternative C, correct? 

A. That's correct. 

Q. So if your goal is to have an accurate census, then 
alternative C is superior to alternative D, correct? 
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A. That's correct. 

Q. Now, under alternative D, due to the lower quality personal 
data on census responses from increased number of households 
going through NRFU, there will also be a reduction in the 
number of individuals whom the Census Bureau can link to 
administrative records, correct? 

A. Yes. I thought that's what we were talking about, but yes, 
that's correct. 

Q. OK. Well, if we look at this, here, if we look at the last 
sentence here, for the 2010 census, you're able to link 93 
percent of self-responses to administrative records, correct? 

A. Yes. 

Q. But for proxy responses obtained through the NRFU process, 
you're only able to link 33.8 percent of such individuals 
through administrative records, correct? 

A. That's correct. 

Q. So just to be clear, under alternative D, there are going 
to be fewer people that you can link to administrative records 
than if you had — if the secretary had instead chosen 
alternative C, correct? 

A. That's correct. 

I said yes. I must be getting — I'm sorry. Yes, that's 
correct. 

Q. OK. 

MR. HO: Now, let's turn back to Secretary Ross's 
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decision memo. Plaintiffs' Exhibit 26, and I want to look at 
page 5 of the memo, the first paragraph on page 5. 

Q. The secretary's discussing alternative D in this paragraph, 
correct? 

A. Yes, he is. 

MR. HO: And I want to ask you about the third 
sentence in this paragraph, starting with "this may eliminate." 
I want to ask you about what Secretary Ross is referring to 
here. 

Q. One limitation of alternative C, using administrative 
records. Dr. Abowd, is that not every person who is enumerated 
in the census can be linked to administrative records, correct? 
A. That's correct. 

Q. So if you rely on administrative records — excuse me, 
under alternative C, to produce block-level CVAP data for DOJ, 
there's a portion of the population for whom you're going to 
have to impute, or model, their citizenship status, correct? 

A. I prefer model, but yes, that's correct. 

Q. The secretary's decision memo suggests that under 
alternative D, that might eliminate the need for such modeling 
of citizenship status for people who cannot be matched to 
administrative records, right? 

A. That's what he says, yes. 

Q. Dr. Abowd, you analyzed the question of whether alternative 
D could potentially address this gap in the administrative 
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records, right? 

A. Yes, we did. 

MR. HO: All right. Let's bring your memo back up, 
from March, Plaintiffs' Exhibit 25. Let's look at page 4. 

Q. And under the header "can survey data address the gaps in 
alternative C," this is the section where you address this 
issue that Secretary Ross is talking about in his memo that we 
talked about a moment ago, whether or not alternative D can 
effectively address that gap in the administrative records, 
right? 

A. There may have been other paragraphs, but it's certainly 
discussed in this one as well. 

Q. Now, under alternative D, if you get a survey response on 
citizenship status for someone who can't be matched to the 
administrative records, you're going to use that survey 
response, right? 

A. We're going to include that survey response in the record 
of the 2020 census, yes. 

Q. Right. I mean, you wouldn't, if you — for this group of 
people who can't be matched to administrative data but you get 
a survey response, you wouldn't model their citizenship status; 
you would take the survey response as to citizenship for that 
person, right? 

A. As I think I've explained in several depositions, we've 
charged a high-level expert panel that I'm the chair of inside 
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the Census Bureau to develop a scientific answer to the 
question you just asked. In the presence of a dual set of 
records on citizenship status, it isn't obvious what the best 
way to translate that into an estimate of citizen voting-age 
population is. 

Q. I apologize. Dr. Abowd. My question was probably 
confusingly worded. I wasn't talking about people for 94 whom 
there are dual records. I mean people who can't be linked to 
the administrative record but for whom you do have a survey 
response as to their citizenship status. You're going to use 
the citizenship response for that person rather than 
modeling — you're going to use the survey response for that 
person rather than modeling their citizenship status, correct? 
A. I suspect that the internal expert panel will draw that 
conclusion, but I want to say, once again, it is unusual to 
dual source this, and it's not necessarily the best scientific 
answer that you always use the survey if you don't have an 
administrative record or that you always use the administrative 
record when you don't have a survey. The modeled answer can be 
defended on objective ground, but we haven't developed it yet. 
Q. There's currently no objective grounds on which if all you 
have about a person's citizenship status is their survey 
response for you to reject the survey response, correct. 

Dr. Abowd? 

A. That's correct. 
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Q. Now, as we established earlier, though. Dr. Abowd, the 
Census Bureau believes that noncitizens give an answer to the 
citizenship question on the ACS that's probably wrong more than 
30 percent of the time, right? 

A. That disagrees with the administrative record more than 30 
percent of the time, yes. 

Q. And you noted in this March memo that a problem with 
relying on the citizenship question to fill gaps in the 
administrative record is that people who are not citizens have 
a strong incentive to provide an incorrect answer to a 
citizenship question if they answer at all, right? 

A. That's correct. 

Q. And the memo notes that even a large fraction of legal 
permanent residents provide incorrect answer, survey responses 
to the citizenship question on the ACS, correct? 

A. That's correct. 

Q. And so, a key difference between alternatives C and D is 
for this population of people for whom you can't link to 
administrative records, under alternative C, you model their 
citizenship status and, under alternative D, if you get it, you 
try to use the survey self-response, right? 

A. I think that's a fair characterization, yes. 

Q. But given the errors in survey responses to citizenship 
questions that we discussed earlier, this memo. Dr. Abowd, 
concludes that survey-collected citizenship data may not be 
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reliable for many of the people falling in the gaps in the 
administrative record, correct? 

A. Correct. 

MR. HO: And let's look at page 4 of your memo. 

Q. The second-to-last sentence in the last paragraph, starting 
with "this suggests," that's where you made that conclusion in 
this memo, right. Dr. Abowd? 

A. That's correct. 

MR. HO: Let's turn to page 5 of the memo and look at 
the first sentence, full sentence, starting with "thus, not 
only are citizenship data." 

Q. Your March memo to Secretary Ross, Dr. Abowd, states that 
citizenship survey data gathered under alternative D, it 
describes such data as being of "suspect quality," correct? 

A. Correct. 

Q. But the memo — 

MR. HO: Let's flip back to page 4 of the memo, and 
the second paragraph, the first sentence. 

Q. The memo describes the administrative data on citizenship 
as "high quality," correct? 

A. Correct. 

Q. Dr. Abowd, there's no reason to think, for the group of 
people that you can't match to administrative records, that on 
average the survey responses under alternative D would be more 
accurate than the modeling that you would conduct under 
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alternative C, right? 

A. That's correct. 

Q. And in fact. Dr. Abowd, for this group of people falling in 
the gaps of the administrative records, your view is that the 
modeled responses to citizenship status under alternative C 
would be more likely to be accurate than the survey 
self-responses to a citizenship question under alternative D, 
correct? 

A. That's correct. 

Q. So, Dr. Abowd, for this group of people who can't be 
matched to administrative records, the Census Bureau's view is 
that the modeled responses to citizenship status under 
alternative C would be more likely to be accurate than the 
survey self-responses to a citizenship question under 
alternative D, correct? 

A. That's correct. 

Q. And as we established earlier. Dr. Abowd, the number of 
individuals you can't match at all to administrative records, 
that's going to be higher under alternative D than under 
alternative C, right? 

A. Also correct. 

Q. So for people who can't be linked to administrative 
records, if you're attempting to determine their citizenship 
status. Dr. Abowd, you would prefer modeling it to a survey 
self-response, right? 
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A. A little too compound. Could you ask it — 

Q. Sure. 

A. — straightforwardly. 

Thank you. 

Q. If you want to get accurate citizenship information about 
people who fall in the gaps of the administrative records. Dr. 
Abowd, your recommendation would be to model their citizenship 
status rather than to try to collect it through a survey 
self-response, correct? 

A. That's correct. 

Q. And Dr. Abowd, if the Department of Justice's goal is to 
get accurate block-level CVAP data, then for this group of 
people who fall in the gaps of the administrative records, the 
best course of action is to use — is to impute their 
citizenship status rather than use a survey question, correct? 
A. Most accurate data would come from modeling their 
citizenship status, that's correct. 

MR. HO: OK. Now let's turn back to Secretary Ross's 
decision memo, page 5. I want to look at the first paragraph 
and the last two sentences that start with "finally." 

Q. I'd like you to read that to yourself and then, when you're 
ready, let me know. 

A. I'm ready. 

Q. In these two sentences in this paragraph. Dr. Abowd, is it 
your understanding that Secretary Ross is suggesting that 
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including a citizenship question on the 2020 census will enable 
the Census Bureau to model citizenship status more accurately 
by determining the accurate ratio of citizen to noncitizen 
responses ? 

A. So, once again, the secretary did not discuss this with me 
so I don't know exactly what nuances he meant. He appears to 
believe that we would get more accurate CVAP data if we had 
access to both the survey responses and the administrative 
data, yes. 

Q. And the assertions in this, these two sentences of this 
paragraph. Dr. Abowd, the commerce department never discussed 
this with the chief scientist at the Census Bureau, right? 

A. It was not discussed with me, that's right. 

Q. Dr. Abowd, the two sentences here, they make technical 
presumptions that the Census Bureau does not currently endorse, 
correct? 

A. Once again, I'm not privy to the technical assumptions. 

They appear to say that the secretary believes it would be more 
accurate if we had access to both the survey responses and the 
administrative data. 

Q. That assertion, as you understand it. Dr. Abowd, makes 
technical presumptions that the Census Bureau would not 
currently endorse, correct? 

A. That's correct. 

Q. And as of March 26, 2018, when Secretary Ross issued this 
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memo, the Census Bureau had not completed any analysis as to 
whether or not the inclusion of a citizenship question would 
better — would enable the Census Bureau to more accurately 
model citizenship status for people falling in the gaps of the 
administrative records, correct? 

A. We hadn't done any of that modeling at that time, that's 
correct. 

MR. HO: I want to ask you about another memo of yours 
that's in the administrative record. Plaintiffs' Exhibit 24. 
This is in the administrative record and has been admitted into 
the trial record. 

Q. You recognize this memo, right. Dr. Abowd? 

A. Yes, I do. 

Q. It's a memo that quantifies, under one set of assumptions, 
some of the data quality differences between alternatives C and 
D, right? 

A. Yes. 

MR. HO: Let's turn to page 3 of the memo and figure 

1. 

Q. Now, this is a breakdown of the Census Bureau's analysis of 
data quality under alternative C, right? 

A. Yes, it is. 

Q. So at the time of this analysis, the bureau posited that 
under alternative C, you could link 295 million out of the 330 
million people whom you expect to enumerate during the 2020 
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census to administrative records containing citizenship, right? 
A. Yes. 

Q. That's about 89.4 percent of the population; sound right? 

A. That does sound right, yes. 

Q. According to this analysis, there's about 35 million people 
whom you'd expect not to be able to link to administrative 
records, right? 

A. That's correct. 

Q. That's about 10.6 percent of the population that would fall 
into that gap of the administrative records that we've been 
discussing, right? 

A. That's correct. 

Q. So under alternative C you would model citizenship status 
for this about 10 percent of the population, right? 

A. That's correct. 

MR. HO: Let's turn to the next page, page 4 of the 
memo, figure 2. 

Q. Now, this is a breakdown of data quality under alternative 
D, correct? 

A. Yes, it is. 

Q. Little more complicated than alternative C, right? 

A. It has more boxes, yes. 

MR. HO: All right. Let's walk through this. 

Q. On the right side of this chart, the bureau posited that 
there would be 35.4 million people for whom you would not get a 
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response to the citizenship question on the 2020 census, right? 
A. Yes. 

Q. And if we look at the far left-hand side of the chart, the 
bureau posits that there are 263 million people who you would 
get a response to the citizenship question and whom you could 
link to administrative records, and the administrative record 
and the citizenship response would be the same, right? 

A. You're on the far left, right? 

Q. Yes. 

A. 263 million? 

Q. Yes. 

A. Yes, that's right. 

Q. So if we add these two groups together, 263 million, where 
the question response and the administrative records are the 
same, and 35.4 million people for whom you don't get an answer 
to the citizenship question at all, that group together, 
collectively, putting a citizenship question on the census 
doesn't give us any better information than if we had no 
citizenship question on the census, right? 

A. Yes, that's right. 

Q. OK. So if we add them together, that's 298.4 million 
people for whom the citizenship question doesn't give us better 
information about their citizenship status? 

A. That's correct. 

Q. That's 90.4 percent of the population, right? 
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A. You've been doing well on the ratios, so I assume you did 
that one right too. Thank you. 

Q. OK. Now let's talk about the rest of the population. You 
have, in the middle branch of this chart, 22.2 million people, 
under alternative D, who you'd expect to give a response to the 
citizenship question and who couldn't be linked to an 
administrative record on citizenship, right? 

A. That's correct. 

Q. And you also have, on the far right-hand side here, 13.8 
million people who have no response to a citizenship question 
and no administrative record on citizenship, right? 

A. That's correct. 

Q. So you add those two numbers together, that's 36 million 
people, under alternative D, who can't be linked to 
administrative records on citizenship, right? 

A. Yes. 

Q. Now, that's more people who can't be linked to 
administrative records than you had under alternative C, right? 
A. That is correct. 

Q. That's because of the reduction in data quality because of 
more NRFU under alternative D, right? 

A. That's correct. 

Q. And that's one of the manifestations in which alternative D 
produces worse data than alternative C, right? 

A. Yes, that's right. 


SOUTHERN DISTRICT REPORTERS, P.C. 
(212) 805-0300 





1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 


982 


Case3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 110 of 176 

IbdWnys5 Abowd - Direct 

Q. OK. Let's look again at the chart and the sort of middle 
subbranch of the left branch of the chart, the 9.5 million. 

Under alternative D, the Census Bureau posited you'd have 
9-1/2 million people for whom the survey self-response on 
citizenship and the administrative record disagree, right? 

A. That's right. 

Q. And you don't have any plan for what you would do with 
those people right now, right? 

A. That we'd have to study, yes. 

Q. And the traditional Census Bureau practice is that if you 
have a survey response that conflicts with an administrative 
record, you generally rely on the survey response, right? 

A. So, I hope that I didn't say so unambiguously in any of the 
depositions that there was a general practice here. I thought 
I said that this was a pretty unusual situation and that's why 
we are going to study it further. We don't generally put 
ourselves in the situation where we have a disagreement and — 
we try to address the disagreements in the design of the data 
product. 

Q. Dr. Abowd, I want to bring you back to your Cctober 5 
deposition, your third deposition in this case. 

A. CK. 

Q. And specifically page 416, line 15: 

"Q. Now, the traditional Census Bureau practice, in general, 
is that if you have a survey response that conflicted with an 


SCUTHERN DISTRICT REPCRTERS, P.C. 
(212) 805-0300 





1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 


983 


Case3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 111 of 176 

IbdWnys5 Abowd - Direct 

administrative record, you generally rely on the survey 
response, correct? 

"A. Correct." 

Was that my question for you and your answer that day? 

A. Yes, it was. 

MR. HO: OK. Can we come back to the chart from the 
memo, figure 2. 

Q. Dr. Abowd, for that group of people, the 9-1/2 million 
people for whom the survey response and the administrative 
record conflict, if you use what you described in your 30(b)(6) 
deposition as the traditional Census Bureau practice of relying 
on the survey response instead of the administrative record, 
you agree that that would probably be more accurate — more 
inaccurate, excuse me, than relying on the administrative 
record, correct? 

A. Yes, I do. 

(Continued on next page) 
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BY MR. HO: 

Q. But if you relied on the administrative record instead of 
a survey response, there would have been no reason to ask a 
survey question in the first place, right? 

A. That's correct. 

Q. Now, to be clear, this problem doesn't exist under the 
alternative C, right? 

A. Also correct. 

Q. Lets come back to this chart. 

Now I asked you a while ago about the 22.2 million people 
who fall in that gap, can't be linked to administrative 
records, but from whom you anticipate getting a response to the 
citizenship question. 

That's an accurate characterization of the 22.2, right? 

A. Not linked? 

Yes, that's correct. 

Q. That is about 6.7 percent of the population that can't be 
linked to administrative records, but under alternative D, you 
have a survey response, right? 

A. That's correct. 

Q. Now, under alternative C, you would expect to be able to 
link some of these people to administrative records, right. 

Dr. Abowd? 

A. Yes, that's correct. 

Q. But leave that aside. 
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For this group of 22.2 million people under alternative D, 
if you follow traditional Census Bureau practices, you would 
use the survey response rather than modeling their citizenship 
status, right? 

A. That's correct. 

Q. And in your opinion, that would be less accurate than if 
you just went with modeling their citizenship status, right? 

A. That's correct. 

Q. Dr. Abowd, if someone argued that alternative D was 
justified because alternative C requires modeling citizenship 
status for people who can't be linked to administrative 
records, you would disagree with that conclusion, right? 

A. I would like you to ask it again. If you could just read 
it back, if you want. I want to make sure I heard the 
qualifying statements exactly. 

Q. Dr. Abowd, if someone argued to you that alternative C 
is — excuse me — I'll try that again. 

Dr. Abowd, if someone argued to you that alternative D is 
justified because under alternative C, you would have to model 
the citizenship status for this pool of people who can't be 
linked to administrative records, you would disagree with that 
conclusion, right? 

A. Yes, I would. 

Q. And the Census Bureau would disagree with that argument, 
right? 
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A. Yes. 

Q. Now, this chart. Dr. Abowd, there is a version of this — 
excuse me — there are multiple versions of this in the Brown 
memo, right? 

A. That's correct. 

Q. I just want to identify them so that the court is aware of 
where they are. 

If we can turn back to Plaintiffs' Exhibit 162, and 
page 50 of the paper. 

Starting on page 50 through pages 53, you go through four 
possible scenarios for data quality under alternative D, is 
that right? 

And can we scroll through those, please. 

A. Yes, that's correct. 

Q. These scenarios all are constructed under different 
assumptions, right. Dr. Abowd? 

A. Yes, that's correct. 

Q. And after conducting all of these scenarios, the conclusion 
of the Census Bureau remains that alternative D produces worse 
data quality than alternative C, correct? 

A. That's correct. 

THE COURT: Did you explain what AD REC means? 

Did I miss that? 

THE WITNESS: I did not, your Honor. It is a 
shorthand for administrative record, ad. rec. 
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THE COURT: Thank you. 

BY MR. HO: 

Q. Lets go back to the Ross memo. Plaintiffs' Exhibit 26. I 
want to look at page five. 

I think that's the Brown memo. The Ross memo. Plaintiffs' 
Exhibit 26. 

The first three sentences of the first paragraph. I want 
to compare this, if we can, to your March memo. Plaintiffs' 
Exhibit 25, page five of your memo, the second to last 
paragraph. 

So Secretary Ross orders option D, but your conclusion 
before he made that decision was that including a citizenship 
question on the 2020 census does not solve the problem of 
incomplete person linkages when producing citizenship 
statistics after 2020, correct? 

A. I confess that I've gotten the providence of boxes 
confused. 

Q. Sure. 

The one on the bottom, that has your conclusion that 
including a citizenship question in the 2020 census does not 
solve the problem of incomplete citizenship linkages when 
producing citizenship statistics? 

A. From the March 1 memo? 

Q. Yes. 

A. OK. Yes. 
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Q. That's correct. Dr. Abowd? 

A. Yes, that's correct. 

Q. When Secretary Ross in his decision memo wrote that 
alternative D may eliminate the need for the Census Bureau to 
have to model citizenship status for millions of people, you 
had already concluded, in fact, that alternative D did not 
solve that problem, right? 

A. That's correct. 

Q. And you also concluded in this memo that alternative C is 
cheaper than alternative D, right? 

A. That's correct. 

Q. And you also concluded that using administrative records 
alone would be more accurate than attempting to combine 
administrative records and survey responses under alternative 
D, right? 

A. That's correct. 

Q. And you communicated all of that to Secretary Ross through 
your memo before his decision memo was issued, correct? 

A. That's correct. 

Q. I want to bring up Plaintiffs' Exhibit 359. This has been 
admitted into the trial record. 

Dr. Abowd, you're familiar with this, right? 

A. Yes. It's statistical policy directive number two. 

Q. From the Office of Management and Budget, correct? 

A. Yes. 
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Q. The Census Bureau is bound by 0MB standards and guidelines, 
correct? 

A. The office of the chief statistician is charged with 
supervising the activities of the statistical agencies of the 
United States Government, yes. 

Q. I want to turn to page 16 of the document, of the PDF which 
is page 11 of the document for the record. 

Standard 2.3 reads: Agencies must design and administer 
their data collection instruments and methods in a manner that 
achieves the best balance between maximizing data quality and 
controlling measurement error while minimizing respondent 
burden and cost. 

I read that correctly, right? 

A. Yes, you did. 

Q. And the Census Bureau is bound by standard 2.3, correct? 

A. The Census Bureau is required by the Office of Management 
and Budget to justify its actions in light of standard 2.3. 

Q. Dr. Abowd, within the meaning of standard 2.3, the 
Secretary's chosen option, alternative D, results in lower data 
quality than the Census Bureau's recommendation of 
alternative C, correct? 

A. That's correct. 

Q. Dr. Abowd, within the meaning of standard 2.3, the 
Secretary's chosen option of alternative D also has a higher 
respondent burden than the Census Bureau's recommendation of 
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alternative C, correct? 

A. That's correct. 

Q. Dr. Abowd, within the meaning of standard 2.3, the 
Secretary's chosen option of alternative D has a higher cost 
than the Census Bureau's recommendation alternative C, correct? 
A. That's correct. 

Q. Guideline 2.3.1 reads: Design the data collection 
instrument in a manner that minimizes respondent burden, while 
maximizing data quality. 

Did I read that right? 

A. Yes, you did. 

Q. Dr. Abowd, choosing alternative D over alternative C does 
not comport with guideline 2.3.1, correct? 

A. So the Census Bureau's obligation is not to determine how 
0MB will interpret guideline 2.3.1 in terms of our actions. 

I think I already said alternative D deliveries higher 
quality data at lower cost. 

Q. And alternative C — 

A. I'm sorry. I misspoke. 

Q. Alternative C deliveries high quality data at lower cost? 

A. That's what I meant to say. Sorry. 

Q. It does so with lower respondent burden, correct? 

A. Yes, it does. 

Q. All of that and choosing alternative C would be consistent 
with guideline 2.3.1, correct? 
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A. Yes, it would. 

Q. In the meetings that you had with Commerce Department 
officials, you heard Commerce Department officials opine that 
alternative D would be better than alternative C, right? 

A. So in none of the meetings — first of all, I only met with 
the Secretary once on this subject. I believe with the Under 
Secretary only once. 

And I believe in those meetings, some staff members 
may have opined there are reasons why they thought that certain 
alternatives would be better. But, frankly, I don't remember 
any such conversations. I remember being asked a lot of 
questions and being asked questions that suggested that one or 
another of the persons in the room thought one way of doing it 
might be better than the other. 

I'm sure I said this in my fact deposition. There was 
a very open discussion with both the Under Secretary and the 
Secretary in the only time I was in a meeting with them on this 
subject. Subsequently, Dr. Lamas had additional discussions 
with them, I think primarily Dr. Jarmin, and I won't 
characterize those because I wasn't in those meetings. 

Q. Dr. Abowd, you remember a meeting where a member of 
Secretary Ross' staff, Earl Comstock, expressed the opinion 
that alternative D would be superior to alternative C because 
it would enable you to fill the gaps in the administrative 
record? 
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A. So, frankly, I don't remember being in a meeting when 
alternative D was already on the table. He was in the meeting 
on February 12, but I don't believe we were discussing 
alternative D at that time, except in the sense of comparing 
B to C. I don't recall being in a meeting with him. 

Q. Dr. Abowd, I'm going to bring up for you a section of your 
deposition transcript on October 5, 2018, page 422, lines 3 
through 11. 

Go ahead and read that and see if it refreshes your 
recollection. 

A. OK. Out loud? 

(Pause) 

Q. Does that refresh your recollection. Dr. Abowd? 

MR. EHRLICH: Your Honor, I would say, again, he is 
testifying there as a 30(b)(6) witness for the Census Bureau. 

THE COURT: I think the law is clear you can show a 
witness absolutely anything to refresh his recollection, so 
that is what is being done here. 

The objection's overruled. 

A. May I ask to see the question that preceded this? 

Q. You could. Sure. 

THE COURT: For the record, I recall a lecture for the 
bar saying that you could refresh recollection with a bowl of 
fettuccine alfredo. By that standard, this is certainly 
proper. 
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Go ahead. 

BY MR. HO: 

Q. The previous question is on page 421, line 17. Feel free 
to read that to yourself. 

Just let me know when you're ready. 

(Pause) 

A. I would like to qualify that — 

Q. I haven't put a question to you yet. Dr. Abowd. 

A. OK. Go ahead. 

Q. Could I? 

A. Yes. Go ahead. 

Q. Reading that, does that refresh your recollection about 
whether or not you've ever heard Earl Comstock express the view 
that alternative D is superior to alternative C because it 
fills in the gaps in the administrative record? 

A. So I understood my duty when I was testifying as the 
agency's 30(b)(6) witness — 

THE COURT: Hold on. Doctor. The answer to that 
question is either yes or no. It either refreshes your 
recollection — 

THE WITNESS: Yes, it does refresh my recollection. 

THE COURT: Now I'm sure Mr. Ho will ask you another 

question. 

BY MR. HO: 

Q. You don't agree with Mr. Comstock's opinion, right. 
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Dr. Abowd? 

A. That's correct. 

Q. And the Census Bureau does not agree with Mr. Comstock's 
opinion, right. Dr. Abowd? 

A. That is correct. 

Q. The Census Bureau communicated its disagreement with that 
opinion to Mr. Comstock, right? 

A. Yes, that is correct. 

Q. And if Mr. Comstock testified in a deposition. Dr. Abowd, 
that the Census Bureau never communicated its disagreement with 
that opinion, Mr. Comstock would be wrong, right. Dr. Abowd? 

A. I believe that's the case, yes. 

Q. Secretary Ross didn't choose alternative C, he chose 
alternative D anyway, right. Dr. Abowd? 

A. That's correct. 

Q. Now, I just want to back up and ask you a few questions 
about how this process unfolded. 

Dr. Abowd, you would agree that normally, the process of 
testing content on the census, is a decade-long process 
involving multiple tests and various randomized control tests, 
correct? 

A. Yes. 

Q. Lets bring up Plaintiffs' Exhibit 271. This has been 
admitted into the trial record. This is 2020 census program 
memorandum series 2016.05, dated April 29, 2016, from Lisa 
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Blumerman. 

A. Blumerman. 

Q. Blumerman. Thank you. Dr. Abowd. 

The subject of this memo is: Plan development and 
submission of subjects planned for the 2020 census program and 
questions planned for the 2020 census program. 

Right, Dr. Abowd? 

A. Yes. 

Q. I'm going to refer to this document as the Blumerman memo. 
OK? 

A. Yes. 

Q. Now, as of the date that she signed this memo, Lisa 
Blumerman was an associate director for the 2020 census, 
correct? 

A. That's correct. 

Q. Lets turn to page three. I want to look at the section 
under the header Federal Agency Input. 

The first paragraph, the last sentence reads: Federal 
agencies with known uses of the 2020 census or ACS content, and 
sector agencies, will receive a letter with instructions for 
how federal data users may provide updates to the documentation 
of data uses. Responses should be received before July 1, 

2016. Census Bureau staff may follow up with federal users 
directly if more clarification is required. 

Dr. Abowd, do these sentence conform to your understanding 
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of how the content review was conducted and presented to 
members of the 2020 census executive steering committee? 

A. Yes. 

Q. The Department of Justice's request to add a citizenship 
question was not received by July 1, 2016, correct? 

A. That's correct. 

Q. To the best of your knowledge, the Department of Justice 
did not previously write to the Census Bureau about adding a 
citizenship question prior to December 2017, right? 

A. That's correct. 

Q. And prior to December 2017, in fact, the Census Bureau had 
never heard from the Department of Justice that existing CVAP 
data produced by the Census Bureau was not ideal for purposes 
of DOJ's VRA enforcement work, correct? 

A. I'll answer your question, but I want to just see if you 
misspoke. 

Did you mean prior to July 1, 2016? You said '17. 

Q. I said December 2017. I think I meant December 2017. 

Before the request, the Gary letter came into the Census 
Bureau, the Department of Justice had never communicated to the 
Census Bureau that ACS CVAP data was not ideal for DOJ's VRA 
enforcement purposes, right. Dr. Abowd? 

A. That's correct. 

Q. Lets go back to the Blumerman memo, and I want to look at 
page four of the memo. 
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There is a header that reads Content Determination, and the 
second paragraph, last sentence reads: Final proposed 
questions are based on the results of extensive cognitive 
testing, field testing, other ongoing research, and input from 
advisory committees. 

That is your understanding of what the process for the 2020 
census was presented to the Census Bureau's 2020 executive 
steering committee, right? 

A. The memo simultaneously describes ACS and 2020 census, but 
I believe that sentence was intended to apply to both, yes. 

Q. Now, your understanding is that the 2010 full census 
questionnaire was subjective to cognitive testing, right. 

Dr. Abowd? 

A. Yes. 

Q. There has been no cognitive testing, however, of the full 
2020 census questionnaire, including a citizenship question, 
correct? 

A. That's correct. 

Q. Now, lets talk about the second component here, the next 
component after cognitive testing, field testing. 

To the best of your knowledge. Dr. Abowd, the full 2010 
decennial census questionnaire was field tested, correct? 

A. That's correct. 

Q. The full 2020 census questionnaire, including a citizenship 
question, has not been field tested, correct? 
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A. That's correct. 

Q. Now, there were, I believe, some recent trials that have 
been described as the end-to-end test this year. Dr. Abowd? 

A. So the 2018 end-to-end census test was conducted this year, 
yes. 

Q. And that is sort of like the last dress rehearsal for the 
2020 census, right? 

A. It's the last large scale test of the 2020 census, correct. 
Q. The end-to-end test did not include a citizenship question, 
correct? 

A. That is correct. 

Q. And as of the date of your last deposition in this case, 
October 12, 2018, there were still no plans for field testing 
of the full 2020 census questionnaire, including a citizenship 
question, correct? 

A. I don't know that you asked me the question in that form at 
my October 12 deposition. 

Q. I wasn't there, so I certainly couldn't have, but let me 
put a different question to you. Dr. Abowd. 

At the time that Secretary Ross made his decision to 
include a citizenship question on the census, there were no 
plans for field testing of the census questionnaire, including 
a citizenship question, correct? 

A. That's correct. 

Q. Now, Dr. Abowd, after the 1990 census, the Census Bureau 
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investigated the possibility of adding a question concerning 
respondents' Social Security numbers on the census short form, 
correct? 

A. Yes. 

Q. And the Census Bureau conducted an RCT comparing a version 
of the short form with and without a question asking for a 
Social Security number, correct? 

A. That's correct. 

Q. And the RCT assessed the impact on self-response rates of a 
Social Security number question, correct? 

A. That's correct. 

Q. And in the RCT, the self-response rate fell off in the 
group that had the Social Security number question by 3.4 
percent, correct? 

A. That's correct. 

Q. And the conclusion that was drawn from that RCT was that 
asking for a Social Security number would be sensitive, right? 
A. Yes. 

Q. And today, the Census Bureau does not request for Social 
Security numbers on the census questionnaire, right? 

A. We never have. 

Q. And one of the reasons for that is a concern about the 
effect of that question on self-response rates, correct? 

A. I believe that's correct, yes. 

Q. And it is your opinion. Dr. Abowd, that for some sub 


SOUTHERN DISTRICT REPORTERS, P.C. 
(212) 805-0300 





1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 


1000 


Case3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 128 of 176 

IBDsNYSG Abowd - Direct 

populations, asking about citizenship might be just as 
sensitive as asking a question about Social Security numbers, 
right? 

A. Yes. 

Q. In fact, it is your opinion that for some sub populations, 
asking a question about citizenship would be more sensitive 
than asking a question about Social Security numbers, correct? 
A. I think I said could, but yes. 

Q. The RCT to assess the effect of a Social Security number on 
self-response rates to the census was conducted before any 
decision was made about whether to include a Social Security 
number question on the census, right? 

A. Yes. 

Q. And no similar RCT has taken place here along those lines 
before a decision was made to include a citizenship question, 
correct? 

A. Yes. 

Q. Lets bring up Plaintiffs' Exhibit 268. 

THE COURT: Actually, lets take our break here instead 
of doing that. It is 3:22. We'll start again at 3:32. 

Because we're still in the direct examination. 

Dr. Abowd, you should not communicate about the substance of 
your testimony with defense counsel. 

I'll see you in ten minutes. Thanks. 

(Recess) 
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THE COURT: All right. Dr. Abowd, you're still under 

oath. 

Mr. Ho, you may continue. 

MR. HO: Thank you, your Honor. 

BY MR. HO: 

Q. Dr. Abowd, I want to ask you about Plaintiffs' Exhibit 268, 
which has been admitted into evidence. 

Dr. Abowd, this is a proposed content test on a citizenship 
question dated May 3, 2018, correct? 

A. Yes. 

Q. This is a proposal for an ROT for a citizenship question on 
the census, correct? 

A. It is an ROT for the content of alternative versions of the 
citizenship question on the — using the ACS, yes. 

Q. This RCT proposal was created by Census Bureau staff, 
correct? 

A. Yes. 

Q. And it was made in May of 2018? 

A. That's correct. 

Q. And the proposal was to initiate an RCT in either November 
of 2018 or February of 2019, correct? 

A. That's correct. 

Q. The RCT, as proposed here, would have taken six weeks to 
collect the data, correct? 

A. Yes. 
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Q. Either if it had been in November of 2018 or February of 
2019, either way the RCT could have been completed before 
census forms are due to be printed, correct? 

A. Yes. 

Q. And the cost of this proposal ranges depending upon the 
options you chose between $2 million for one option to 
$4.1 million for another option, correct? 

A. Yes. 

Q. The Census Bureau has that money, right. Dr. Abowd? 

A. Yes. 

Q. This proposal was rejected by a group of decision-makers, 
including Under Secretary Karen Dunn Kelley, correct? 

A. As I testified in my 30(b)(6), the decision not to conduct 
this RCT was made by — excuse me — Dr. Enrique Lamas' 
consultation with the Under Secretary, yes. 

Q. I would like to bring up Plaintiffs' Exhibit 271, the 
Blumerman memo. 

THE COURT: Who was the second person. Dr. Jarmin? 

THE WITNESS: Deputy, Acting Deputy Director Enrique 
Lamas. Dr. Lamas. 

THE COURT: Thank you. 

BY MR. HO: 

Q. Back to page four of the Blumerman memo. 

The page entitled Content Determination, and that last 
sentence in the second paragraph. 
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We talked about cognitive testing, field testing, and RCT, 
which I put in the category of ongoing research. Those are all 
different things, right. Dr. Abowd; like doing an RCT and 
conducting that, that doesn't take the place of cognitive 
testing and field testing, right? 

A. In some cases, they are intertwined, but they are 
considered distinct activities, yes. 

Q. Lets talk about — I'm sorry. One other question. 

If you do an RCT and the results come out suggesting that a 
question could reduce response rates, do you just plow ahead 
and do that, or would you conduct more analysis before using a 
question that you had tested? 

A. When we conduct an RCT, we expect it to produce actionable 
data, and exactly what actions would be taken as a consequence 
of those data depends on the structure of the RCT and the point 
in the survey development cycle that it is conducted. 

Q. Just to be clear, doing an RCT, it is not like a box that 
you check, and regardless of what the results are, you just 
say. Great, we've conducted an RCT, we can go ahead now? 

You have to actually look at the results of the RCT 
and incorporate that into your process, correct? 

A. That is the justification for running an RCT, yes. 

Q. OK. Lets talk about the next item here, input from 
advisory committees. 

Input was not solicited from the Census Bureau's advisory 
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committees before Secretary Ross made his decision to add a 
citizenship question to the 2020 census, correct? 

A. That's correct. 

Q. If you had been given more advance notice, then the Census 
Bureau could have consulted with, for example, CSAC, the Census 
Scientific Advisory Committee, before a decision was made, 
right? 

A. Yes. 

Q. And if you had been given more advance notice, you would 
have convened a working group with the advisory committees to 
study the citizenship question, right? 

A. Probably. 

Q. And you would have discussed that question actively with 
the working groups, right? 

A. Yes. 

Q. But no such act of discussions with the advisory committees 
happened before Secretary Ross made his decision, correct? 

A. That's correct. 

Q. Now, backing up to talk again a little bit more about the 
process before Secretary Ross made his decision. Dr. Abowd, 
after you communicated the Census Bureau's initial views in 
your February 12 memo with Secretary Ross, the Commerce 
Department sent a list of 35 followup questions to the Census 
Bureau, correct? 

A. Yes. 
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Q. And some of those questions concerned testing, right? 

A. Yes, they do. 

Q. OK. Lets bring up Plaintiffs' Exhibit 140. 

These are draft responses to those 35 questions from 
the Commerce Department, right? 

A. Draft responses from the Census Bureau to the Commerce 
Department, yes. 

Q. Thank you for that correction. 

Just for the record, this document has been admitted into 
the trial record, and it is part of the supplemental 
administrative record in this case. 

Dr. Abowd, it is your belief that Acting Director Jarmin 
intended for you to take responsibility for making sure that 
the answers to these questions were accurate, correct? 

A. For the vast majority of them, yes. He asked me to track 
that the person assigned to deliver an answer had done so, to 
vet that answer, to communicate that answer to Burton Reist, 
the chief of the decennial communications office, and then 
Burton Reist was charged with delivering those answers to the 
Commerce Department on a flow basis. They did go back and 
forth before we determined that we adequately answered each of 
the questions. 

Q. It is your understanding that Acting Director Jarmin 
intended you to be ultimately responsible for making sure that 
the answers to these questions were accurate, correct? 
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A. Yes. 

Q. Lets turn to page six in these draft responses, which is 
administrative record page 10900. 

I want to ask you about question 31. Question 31 asks: 

What was the process that was used in the past to get questions 
added to the decennial census, or do we have something similar 
where a precedent was established. 

Did I read that right? 

A. Yes. 

Q. The draft response reads: The Census Bureau follows a 
well-established process when adding or changing content on the 
census or ACS to ensure the data fulfill legal and regulatory 
requirements established by congress. Adding a question or 
making a change to the decennial census or the ACS involves 
extensive testing, review, and evaluation. This process 
ensures the change is necessary and will produce quality, 
useful information for the nation. 

Did I read that right? 

A. Yes, you did. 

Q. OK. The text here in this draft response, this was sent 
from the Census Bureau to the Commerce Department, correct? 

A. As I said before, several versions were sent, but I believe 
this is one of them, yes. 

Q. This is one of the versions of the draft response to 
question 31 that the Census Bureau sent to the Commerce 
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Department? 

A. Yes. 

Q. And this states that, in this draft response, that adding 
a question to the decennial census or ACS involves extensive 
testing, review, and evaluation, correct? 

A. Yes. 

Q. And as of March 1, 2018, that was your understanding, that 
adding a new question to the decennial census involves 
extensive testing, review, and evaluation, correct? 

A. Correct. 

Q. I want to show you a different version of this document. 

I'm sorry. Before we move on, could we bring that back up 
just for a second. On the next page, I just want to look at 
the bullets here. 

I'm sorry. Can we get the text just above the bullets too. 
This is part of the draft response to question 31, right. 
Dr. Abowd? 

A. Yes. 

Q. It reads: The Census Bureau and the Office of Management 
and Budget (0MB) have laid out a formal process for making 
content changes. 

Then there is a series of six bullets after that, right? 

A. Correct. 

Q. And is it an accurate summary to say that this formal 
process, as described in these draft responses, includes 
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federal agencies evaluating their data needs, a proposal that 
demonstrates a clear statutory regulatory need for the data, 
final proposed questions resulting from extensive cognitive and 
field testing, several opportunities for public comment, a 
decision made in consultation with 0MB, and then finally, if 
approved, the Census Bureau implementing the change, is that 
right? 


A. 

Yes 

• 




Q. 

OK. 

Now, I want to 

show 

you Plaintiffs' Exhibit 

23 . 


Dr . 

Abowd, this has 

been 

admitted into evidence. 

and it is 


in the initial administrative record in this case as the final 
version of responses to the 35 questions. 

Does that comport with your recollection? 

A. May I see all the pages of the document, please? 

Q. Sure. Maybe we could scroll through. 

Does that look right to you. Dr. Abowd? 

A. Yes. 

Q. Just to be clear, this version of the document was produced 
in the initial administrative record in this case, but the 
draft responses that we were talking about earlier, those were 
not in the initial administrative record in this case, is that 
your recollection? 

A. It's my recollection that this is the version that was in 
the first 1300 or so pages of administrative record that were 
these, yes. 
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Q. Lets look at page 11 and the response to question 31 that 
is in the final version of these responses in the 
administrative record. 

Question 31 about the process used in the past for adding 
questions to the decennial census, the final version of this 
response reads: Because no new questions have been added to 
the decennial census (for nearly 20 years), the Census Bureau 
did not feel bound by past precedent when considering the 
Department of Justice's request. Rather, the Census Bureau is 
working with all relevant stakeholders to ensure that legal and 
regulatory requirements are filled and that questions will 
produce quality, useful information for the nation. As you are 
aware, that process is ongoing at your direction. 

Did I read that correctly? 

A. Yes, you did. 

Q. OK. So the final version of these responses, as found in 
the initial administrative record in this case, makes no 
reference to a well-established process for adding content to 
the census, right? 

A. That's correct. 

Q. Instead, the final version in the administrative record 
says that the Census Bureau did not feel bound by past 
precedent, right? 

A. That's what it says. 

Q. And this final version here in the initial administrative 
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record in this case, it makes no reference to extensive 
testing, review, and evaluation, correct? 

A. That's correct. 

Q. It also makes no reference to ensuring that a change to the 
census is necessary, right? 

A. It makes reference to consulting with stakeholders, but it 
doesn't explicitly say the things that the original answer 
said. 

Q. It doesn't use the word necessary to ensure that a change 
is necessary to the 2020 census, right. Dr. Abowd? 

A. That's correct. 

Q. Dr. Abowd, you didn't write this final version of the 
response to question 31 that appear in the administrative 
record, right? 

A. That's correct. 

Q. You're not sure who wrote it, right? 

A. That's also correct. 

Q. You don't know if someone at the census — I mean, you're 
not aware of someone at the Census Bureau having written this. 
Dr. Abowd? 

A. I had the control copy, and it is not in the last version 
of the control copy in the folders that were searched for the 
production of the administrative record. 

Q. So this version. Dr. Abowd, that says that the Census 
Bureau did not feel bound by past precedent, that phrase is not 
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in the last version of this document in the possession of the 
Census Bureau, correct? 

A. As far as I know, correct. 

Q. This final version. Dr. Abowd, which makes representations 
about what the Census Bureau felt bound by, was not written by 
someone at the Census Bureau, right. Dr. Abowd? 

A. Not to the best — not to the best of my knowledge. 

Q. Are you aware. Dr. Abowd, that this was written by someone 
at the Commerce Department? 

A. I don't know who wrote this. 

THE COURT: Do you know if any of the other questions 
changed between the final copy that you had on your computer 
and this copy? 

THE WITNESS: I do not believe any other answers are 

changed. 

BY MR. HO: 

Q. Dr. Abowd, just to close the loop on something you 
mentioned earlier. You made a reference to a control copy. 

What did you mean by that? 

A. I meant that because I was keeping track of who had been 
assigned to answer the questions, and then when I got an answer 
back from that person getting that answer vetted, and then 
copying it into the control copy — master copy, I think, is a 
synonym — that I understood to be the final versions of each 
of those answers. 
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Q. So you maintain possession of the master version of 
responses to these questions, right? 

A. We had some custody issues. Burton Reist also had a 
version that he exchanged without passing through the control 
copy, but we did synchronize them. 

Q. OK. And as far as you know, the final version of the 
answer to question 31, a question that was posed by the 
Commerce Department to the Census Bureau and which makes 
representations about what the Census Bureau felt bound by, 
was not written by someone at the Census Bureau, correct? 

MR. EHRLICH: Objection. 

THE COURT: Sustained. 

Can you tell me what you did with the control copy as 
you've described it? 

In other words, where did it go between the time that 
you considered it to be final and the creation of this 
document; do you know? 

THE WITNESS: So, I do, your Honor. I know that 
Deputy Director, Acting Deputy Director Lamas asked Burton 
Reist, who is the chief of the decennial communications office, 
to communicate the answers back to Commerce on a flow basis. 

So I was keeping a master copy, but Burton was sending 
answers by e-mail as we made them and as they were vetted up to 
Commerce. Several incomplete copies of the document were 
exchanged back and forth, and eventually inside the Census 
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Bureau, around March — 1, there is a date on the control copy, 
I think it is March 1 — we agreed that these were the final 
answers. 

That is the copy that I have sitting in my — well, 
there was an area of secured disk that we were using to store 
the documents related to the citizenship question that is still 
there. 

THE COURT: What, if anything, did you do with it 
after March 1, when, as far as you were concerned, it was the 
final version? 

THE WITNESS: I believe I was copied on an e-mail 
where it was communicated back, then I just moved on. 

THE COURT: Communicated back meaning sent? 

THE WITNESS: Sent to Commerce. 

THE COURT: By Commerce, you mean who at Commerce 
would have received it? 

THE WITNESS: So these e-mail threads tended to grow 
organically. Burton Reist would initiate them, and then there 
would be a back-and-forth exchange, and then someone like 
Dr. Lamas would ask to put a consolidated set together and send 
them up and say these are — he would have called it the latest 
version. There was a lot of back and forth because they asked 
for a lot of clarifications as we were developing the answers. 
And, in fact, the final version has a spreadsheet addendum that 
I haven't been shown, but I think is the next thing in the 
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administrative record. 

So around March 1, after we had all agreed that these 
were the answers, and as we understood it. Commerce had agreed 
that we had answered their questions, I marked the March 1 copy 
that was sent, whatever date it was sent, I believe it was 
March 1, I marked that copy in the secured folder the final 
one. 

THE COURT: All right. But do you, sitting here 
today, do you know who that copy was sent to at Commerce? 

THE WITNESS: I believe it is in the administrative 
record, the e-mail that conveyed it, but I don't remember. I 
believe at least the Under Secretary would have been on the 
list. 

THE COURT: The Under Secretary being Kelley? 

THE WITNESS: Dunn Kelley. 

THE COURT: Thank you. 

BY MR. HO: 

Q. The text written in this final version of the response to 
question 31 posed by the Commerce Department to the Census 
Bureau, Dr. Abowd, this is not the text in the final version 
that the Census Bureau transmitted to the Commerce Department, 
correct? 

A. That's correct. 

Q. Lets go back to Plaintiffs' Exhibit 26, Secretary Ross' 
decision memo. 
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I want to look, again, at that second paragraph on the 
first page, following receipt of the DOJ request. That 
sentence. 

Dr. Abowd, the analyses that we've been discussing that you 
conducted of a possible effect of a citizenship question on the 
census, you did all that on pretty short notice, right? 

A. Relatively quickly, yes. 

Q. I mean, you learned about it around December 15, 2017, and 
you turned around a memo to the Commerce Secretary January 19, 
right? 

A. That's correct. 

Q. A lot of analysis in a short period of time, right? 

A. I have to say, that isn't particularly unusual, but it is 
correct. 

Q. It was over the holidays too, right? 

A. That is also true. 

Q. And you performed that work to the best of your ability, 
right? 

A. Yes. 

Q. Do you think it was an impressive amount of work that the 
swat team under your direction produced in that period of time. 
Dr. Abowd? 

A. My understanding is they didn't get a lot of sleep. 

Q. I mean, you're submitting it for peer review for 
publication, right? 
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A. So I'm not an author of the technical paper. It has not 
yet been submitted for peer review, but we do expect to do 
that. That is the reason it was released as a technical paper, 
yes. 

Q. The entire time you were conducting that analysis over the 
holidays, you were operating under the impression that the 
Secretary set out to take a hard look at this issue following 
the Department of Justice's request, correct? 

A. Yes. 

Q. And you were under the impression that all that hard work 
that you were doing might have some bearing on the Secretary's 
ultimate decision, correct? 

A. Yes. 

Q. I want to bring up Plaintiffs' Exhibit 2. This is the 
supplemental memorandum by Secretary of Commerce Ross in the 
administrative record that's been admitted. I want to 
highlight the first three sentences. 

I want to talk about — well, lets just talk about the 
second sentence. 

Soon after my appointment as Secretary of Commerce, I 
began considering various fundamental issues regarding the 
upcoming 2020 census, including funding and content. 

The next sentence reads: Part of these considerations 
included whether to reinstate a citizenship question, which 
other senior administration officials had previously raised. 
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Dr. Abowd, now, you know that Secretary Ross, as stated in 
his supplemental memo in the administrative record, began 
considering this issue of a citizenship question soon after his 
appointment as Commerce Secretary in early 2017, correct? 

A. Yes. 

Q. OK. But during that period, when you and the swat team 
were working hard on your analysis between the middle of 
December of 2017 and January of 2018, you were not aware that 
Secretary Ross had begun considering a citizenship question in 
early 2017, right? 

A. That's correct. 

Q. And at the meeting that you had with Secretary Ross on 
February 12, when you presented your findings from all of that 
analysis that you conducted, no one mentioned to you that 
Secretary Ross had already begun considering this question in 
early 2017, correct? 

A. That's correct, but we did have a very open discussion. 

Q. That open discussion didn't include the fact that Secretary 
Ross had already begun considering this issue in early 2017, 
right. Dr. Abowd? 

A. That's correct. 

Q. And as of the date of Secretary Ross' decision memo, you 
were not aware that Steve Bannon and Secretary Ross had had 
conversations about whether or not Secretary Ross would speak 
to Kansas Secretary of State Kobach about Mr. Kobach's ideas 
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for a citizenship question on the census, correct? 

A. That's correct. 

Q. As of the date of Secretary Ross' decision memo, you were 
not aware that Secretary Ross had a telephone conversation with 
Mr. Kobach about Mr. Kobach's ideas for a citizenship question 
on the census, right? 

A. That's correct. 

Q. And as of the date of Secretary Ross' decision memo, you 
were not aware that in May of 2017, seven months before the 
Department of Justice's request to the Census Bureau, Secretary 
Ross wrote an e-mail to Earl Comstock stating that he was, 
quote, mystified why nothing have been done in response to my 
months' old request that we include a citizenship question, 
correct? 

A. I was not aware of that, correct. 

Q. And as of the date of Secretary Ross' decision memo, you 
were not aware that in response to that e-mail, Earl Comstock 
wrote to Secretary Ross that, quote, on the citizenship 
question, we will get that in place and, quote, and that it 
would be necessary to, quote, work with justice to get them to 
request that citizenship be added back to a census question, 
correct? 

A. I was not aware of that, correct. 

Q. Dr. Abowd, I want to show you again some deposition 
testimony that has been designated as evidence in this case. 
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For the record, your Honor, it is page 67, line five, 
of Acting Attorney General John Gore's deposition through line 
five of page 68. 

I want to ask you some questions. 

MR. EHRLICH: Your Honor, same objection as last time. 
THE COURT: Same ruling. 

(Videotape played) 

BY MR. HO: 

Q. Dr. Abowd, when you conducted all this work up through the 
date of Secretary Ross' decision memo, you were not aware that 
the Department of Commerce had initiated conversations with the 
Justice Department about the citizenship question rather than 
the other way around, correct? 

A. That's correct. 

Q. During your meeting with Secretary Ross on February 12, no 
one told you that, right? 

A. That's correct. 

Q. You didn't learn that it was Department of Commerce 
officials who had requested that a citizenship question be 
added to the census, rather than the other way around, until 
after this litigation was initiated, right. Dr. Abowd? 

A. That's correct. 

Q. And that was when the administrative record in this 
litigation was lodged in June of this year, right. Dr. Abowd? 

A. That's correct. 
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Q. Dr. Abowd, you were surprised, weren't you, when you 
learned that it was Commerce officials who had requested that 
the Department of Justice request a citizenship question on the 
census, correct? 

A. Yes. 

Q. And among the senior executives at the Census Bureau, 
everyone you know was also surprised to learn that the 
Department of Commerce had initiated conversations with the 
Department of Justice to convince the Department of Justice to 
request that the citizenship question be added to the 2020 
census, correct? 

MR. EHRLICH: Objection, mischaracterizes the 

evidence. 

THE COURT: Overruled. 

A. Could you restate the question, please? 

Q. Sure. 

Among the senior executives at the Census Bureau, 

Dr. Abowd, everyone you know was also surprised to learn that 
it was the Department of Commerce that reached out to the 
Department of Justice to ask the Department of Justice to 
request a citizenship question, correct? 

A. Everyone I know at the Census Bureau, including all the 
senior executives, were surprised by the portion of the 
administrative record that predates December 12, 2017. 

Q. Dr. Abowd, as recently as August of this year. Commerce 
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Department officials still hadn't spoken with you about the 
fact that it was the Department of Commerce that had requested 
the Department of Justice request that a citizenship question 
be added to the 2020 census, correct? 

A. That's correct. 

Q. So to be clear. Dr. Abowd, that entire period of time from 
December, the middle of December, when you began analyzing the 
effect of the citizenship question, up through until June, when 
the administrative record in this case was lodged, your 
impression was that all that work that you were doing mattered, 
that it might affect the secretary's decision-making, right? 

MR. EHRLICH: Objection. 

THE COURT: Overruled. 

A. From the beginning of the time we spent working on our 
technical response until today, I am discharging my obligations 
as the chief scientist at the Census Bureau. 

Q. Dr. Abowd, my question, though, was that entire period of 
time from when you began conducting your analysis in the middle 
of December of 2017 up until when you saw the administrative 
record lodged in this case, you were under the impression that 
all of that work that you had done analyzing the effect of a 
citizenship question, that it mattered as far as the 
Secretary's decision-making process, right? 

A. I was under the impression that it mattered in the conduct 
of the 2020 census, yes. 
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Q. And no one ever told you during that entire period of time 
that Commerce Department officials had initiated this entire 
process, correct? 

A. No one told me that, but I am still under the impression it 
matters for the 2020 census. 

(Continued on next page) 
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BY MR. HO: 

Q. Dr. Abowd, the 2020 census questionnaire will be finalized 
by June of 2019, correct? 

A. That's when the final artwork is due at the printers, yes. 
Q. With existing resources the Census Bureau can lock down the 
content of the census questionnaire by June 30, 2019, correct? 
A. That's correct. 

Q. Under the current budget, if there are changes to the paper 
questionnaire after June of 2019, that would impair the Census 
Bureau's ability to timely administer the 2020 census, correct? 
A. That is correct. 

Q. With exceptional resources, the final date for locking down 
the content of the census questionnaire is October 31, 2019, 
correct? 

A. That is correct. 

Q. Changes after October 31, 2019, would require major 
redesigns and might require congressional authorization, in 
your understanding, right. Dr. Abowd? 

A. That is correct. 

MR. HO: I want to return again to the Ross decision 
memo. Dr. Abowd, Plaintiffs' Exhibit 26. I want to look at the 
final page, page 8, the top paragraph, here. 

Q. The secretary concluded that a citizenship question on the 
decennial census was necessary to provide a complete and 
accurate response to the DOJ request, correct? 
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A. Yes. 

Q. I want to ask you about that and I want to — before 
getting too deep into that determination, I want to ask you 
about the kinds of data that DOJ currently has available. The 
Census Bureau produces various data files for redistricting 
purposes, right. Dr. Abowd? 

A. Yes. 

Q. And one of those redistricting data products from the 
Census Bureau is called the PL 94-171 data file, correct? 

A. Yes. 

Q. The PL 94-171 data file has information in it concerning 
total population at various levels of census geography, 
correct? 

A. Yes, it does. 

Q. And it has voting-age population at various levels of 
census geography, correct? 

A. Yes. 

Q. And it has voting-age population broken down by race and 
ethnicity at the census block level in it, correct? 

A. Yes. 

Q. But it does not have citizen voting-age population in it 
broken down by race and ethnicity at the individual block 
level, correct? 

A. That's correct. 

Q. The data in the PL 94-171 data file, that's based on 
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responses to the decennial enumeration, correct? 

A. Yes. 

Q. And the Department of Justice uses that data file, right? 

A. That's my understanding, yes. 

Q. Also available to the public? 

A. Yes, it is. 

Q. The PL 94-171 data file, that's never had citizen 
voting-age population by race and ethnicity down to the block 
level, correct? 

A. The PL 94-171 data have never included citizenship, that's 
correct. 

Q. Never included citizenship data in it at any level of 
geography, correct? 

A. To the best of my knowledge, yes. 

Q. So, for citizen voting-age population, the Department of 
Justice, when it's doing its redistricting-related work, uses a 
separate tabulation of data from the Census Bureau, correct? 

A. That's correct. 

Q. And that's what we could call the CVAP tabulation? 

A. Yes, sir. 

Q. That's publicly available not just for the Department of 
Justice, right? 

A. All such tabulations are publicly available, yes. 

Q. Now, before the ACS — I'm sorry. 

And the CVAP tabulation, that's based on responses to the 
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American Community Survey, correct? 

A. That's correct. 

Q. Now, before the American Community Survey, the Census 
Bureau produced CVAP data based on responses to the census long 
form, right? 

A. Yes. 

Q. Census long form was not distributed to the entire 
population, correct? 

A. That's correct. 

Q. So data derived from the long form, those were statistical 
estimates based on a sample survey, right? 

A. Yes. 

Q. That's also true of the ACS; that citizenship data derived 
from the ACS is also a statistical estimate based on a 
statistical sample, correct? 

A. Yes. 

Q. So both the long-form CVAP data used in the past and the 
ACS CVAP data used at present, both statistical estimates based 
on survey samples, correct? 

A. Yes. 

Q. And they both had margins of error, correct? 

A. Sampling error, yes. 

Q. Now, the total population data in the PL 94-171 data file, 
that's not sample-based, right? 

A. That's correct. 
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Q. But that data still does have some margins of error 
associated with it, right? 

A. It has a nonsampling error, is what we call it, yes. 

Q. The citizenship question, the proposal to add a citizenship 
question to the 2020 census is sometimes referred to as 
"reinstating a citizenship question." Have you heard that 
phrase. Dr. Abowd? 

A. I believe that's the phrase the secretary used, yes. 

Q. OK. And just to be clear, the 2000 census form sent to 
every household in America, that didn't have a citizenship 
question on it, right? 

A. That's correct. 

Q. And the citizenship data that DOJ currently uses based on 
statistical — based on survey sample, that's not different 
from long-form citizenship data that the Department of Justice 
used to rely on in the sense that both are statistical samples 
with margins of error, right? 

A. Both are samples with sampling error. Their designs are 
very different, so I don't — I'm not saying yes to them being 
identical. They're both sample-based. The design of the 
American Community Survey is very different from the design of 
the old long-form sample. 

Q. But it's not the case that one's a hard count and the other 
is not; they were both statistical samples with margins of 
error, right? 
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A. That's correct. 

Q. That's never changed, as far as you know; the Department of 
Justice, when it's needed CVAP data, it's always needed — it's 
always relied on statistical samples with margins of error, 
right? 

A. To the best of my knowledge, yes. 

Q. Now, the ACS data are produced in both one-year and 
five-year bases, correct? 

A. Tabulations of at least, yes, one-year and five-year 
summaries. Yes. 

Q. One-year ACS estimates are produced from data collected in 
a single calendar year, right? 

A. Yes. 

Q. And five-year ACS estimates are produced based on data 
collected over a consecutive five-year period, correct? 

A. That's correct. 

Q. You'd agree that five-year ACS estimates have larger sample 
sizes than one-year ACS estimates, right? 

A. For the same geographic area, yes. 

Q. And five-year ACS estimates in comparison to one-year ACS 
estimates for the same geographic area would have smaller 
margins of error, correct? 

A. Yes. 

Q. And that would mean they're more precise than one-year ACS 
estimates, right? 


SOUTHERN DISTRICT REPORTERS, P.C. 
(212) 805-0300 





1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 


1029 


Case3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 157 of 176 

IbdWnys7 Abowd - Direct 

A. As long as timeliness is not a salient feature, yes. 

Q. The tabulation of CVAP data produced from the ACS is based 
on five-year ACS estimates, not one-year ACS estimates, 
correct? 

A. Correct. 

Q. And the reason for that is that one-year ACS estimates are 
deemed sufficiently reliable only for areas that have a 
population of more than 65,000 people, correct? 

A. There are a few additional criteria, but that's basically 
correct. 

Q. By contrast, five-year ACS estimates are published by the 
Census Bureau as being reliable for smaller — geographic areas 
with smaller populations, correct? 

A. That's correct. 

Q. As of today, it still hasn't been decided whether the PL 
94-171 file with total population data will also include the 
block-level CVAP data that the Census Bureau expects to 
assemble after the 2020 census, correct? 

A. That's correct. 

Q. So even if a citizenship question is included on the census 
questionnaire, as of now, we don't know whether or not there's 
going to be a single data set that has both total population 
and block-level CVAP data broken down by race or ethnicity, 
correct? 

A. We don't know there will be a single data set, but we did 


SOUTHERN DISTRICT REPORTERS, P.C. 
(212) 805-0300 





1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 


1030 


Case3:18-cv-01865-RS Document 172-1 Filed 01/13/19 Page 158 of 176 

IbdWnys7 Abowd - Direct 

commit to delivering block-level CVAP data in a timely fashion 
consistent with the delivery date for the PL 94. 

Q. The Census Bureau hasn't made a decision yet about how it 
will process responses to the citizenship question alongside 
the administrative citizenship data that you have, correct? 

A. That's correct. 

Q. Dr. Abowd, even if a citizenship question remains on the 
2020 census questionnaire, the Census Bureau hasn't determined 
whether the block-level CVAP data that it produces will, in 
fact, be based primarily on responses to the citizenship 
question, correct? 

A. That is correct. 

Q. Dr. Abowd, let's assume now that the citizenship question 
stays on the 2020 census questionnaire and let's talk about 
how, to the extent you know right now, that would play out in 
practice in terms of producing a block-by-block-level-CVAP 
data. Responses to the census questionnaire are prohibited 
from disclosure under Title 13, correct? 

A. Publications identifying a business or individual or 
household specifically and providing identifiable data on that 
entity are prohibited. 

Q. And that prohibition on disclosure also applies, as far as 
you know, on prohibiting the disclosure of that information to 
the Department of Justice, correct? 

A. That's correct. 
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Q. Now, census blocks vary significantly in terms of the size 
of their populations, correct? 

A. Yes, they do. 

Q. Some census blocks have fewer than ten people on them, 
right? 

A. Yes. 

Q. Some census blocks have one person on them, right? 

A. That's correct. 

MR. HO: I want to bring up Plaintiffs' Exhibit 513, 
which we're using purely for demonstrative purposes. This is a 
map of the Fort Myers area, census blocks in Fort Myers, and if 
we could blow up kind of the middle of the map around where it 
says Lee. This was built using data from the Census Bureau's 
publicly available website of the total population on various 
census blocks. 

Q. Dr. Abowd, if we look at some of these squares right around 
Lee, I mean, all of the census blocks right around where Lee is 
written have fewer than ten people on them, right? 

A. Yes. 

Q. And several of them have only one person on them, right? 

A. Yes. 

Q. So, Dr. Abowd, you'd agree with me that with respect to a 
census block that has only one person on it, when the Census 
Bureau produces block-by-block citizenship data, the Census 
Bureau was legally prohibited from producing data that would 
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accurately reflect what that one person said in response to a 
citizenship question on the census, correct? 

A. We interpret that provision of Title 13 as prohibiting us 
from releasing data at the block level that would make it 
possible to identify the person who supplied those data. 

Q. So when you produce block-by-block CVAP data, for a block 
with one person, you're not going to produce data that reveals 
that person's response to the citizenship question, right? 

A. We'll apply disclosure avoidance before tabulating that 
block, yes. 

Q. So if a person exists in a block with one person on it, 
right where it says Lee, to the right, diagonally above it, 
that person says "I'm not a citizen" in response to the 
citizenship question, and you publish a total number of 
noncitizens for that block, can you publish one? 

A. If they said they're not a citizen? 

Q. Yes. Can you publish one for there's one noncitizen on 
this block? 

A. So what we would do is we would add random noise to the 
tabulation, reconstruct the microdata and then publish the 
counts from the random noise. The random noise introduces 
substantial uncertainty about the single person and less and 
less uncertainty as the number of persons involved increases. 
Q. And the reason why you do that. Dr. Abowd, is because if 
you didn't do it, publishing the CVAP data at the block level 
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would create what you might call re-identification risks for 
that person, right? 

A. Yes. 

Q. And just so we're all clear, re-identification is when 
there's data that's anonymous but a third party can look at it 
and then manage to discover the individual to which that data 
belongs, right? 

A. That's correct. 

Q. And you apply data disclosure-avoidance techniques to 
prevent that from happening, right? 

A. That's correct. 

Q. And you don't just do that for census blocks that have a 
single person on them; you do that for every census block, 
right? 

A. That's right. 

Q. So, Dr. Abowd, there won't be a single census block in 
which the citizenship numbers, as reported by the census after 
the 2020 census questionnaire, reflect the actual responses 
reported by the people who live there in their responses to the 
citizenship question on the 2020 census, correct? 

A. Except randomly, correct. 

THE COURT: Can I just ask a few questions about how 
this works. 

First of all, by way of background, how is it 
determined what a census block is? Why do some have zero 
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people, some have one, some have hundreds? 

THE WITNESS: So, your Honor, census blocks are used 
for two basic purposes. One purpose is to organize the work 
flow in collecting census, we generally call enumeration 
blocks. And the other is for producing summaries later on. We 
generally call them tabulation blocks. They're not exactly the 
same, but they're very similar. 

A tabulation block is the lowest level of geography, 
smallest level of geography that we publish any data on, and we 
publish it so that users of those data can assemble arbitrary 
geographic areas, like school districts or voting districts, 
with enough granularity so that they can meet the purpose of 
making a school district or a voting district. And so the 
granularity in the block definitions is determined over the 
course of the decade by negotiation in many cases with 
bipartisan redistricting offices to determine that the, 
basically the pixel that you're going to build geographic units 
from is sufficiently small that you can get the geographic 
areas you're trying to draw accurate enough but not so small 
that we're simply releasing one — the contents of each address 
in the MAE. 

THE COURT: All right. Thank you. That's helpful. 

And then could you just flesh out what the process 
involves of introducing random noise, what that means in 
practice. I don't know if it's helpful to use some of these 
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census blocks by way of example, but how would you mask, in 
this Lee census block that has only one person in producing 
that data to the Justice Department or whomever, how would you 
mask that person's citizenship? 

THE WITNESS: So, one of the things we're doing with 
the 2020 census is we are moving from what is called 
traditional statistical disclosure limitation to modern 
disclosure limitation processes that were invented by 
cryptographers, and the particular process that we're using is 
called differential privacy. That's a system where you — you 
set up a mathematical guarantee about how much any user of the 
data can learn about an individual who contributes to those 
data, and that mathematical guarantee looks like, if I do the 
tabulation with your data in or out of the overall database, 
the statistics that I produce are only allowed to be different 
by an amount epsilon. So basically, your — the statistics 
with or without your data are indistinguishable from the 
statistics, the statistics with your data are indistinguishable 
from the statistics without your data by an amount that 
controls the randomness that we add. 

We have developed a lot of public materials on this, 
but we're not as practiced in talking about it as the 
historical methods that we use, as you might have noticed from 
the awkwardness of that answer, for which I apologize. So it 
basically says you make the tabulation from the real data, you 
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add an amount of noise to each, in this case block, in the real 
data that's been calibrated so that I can make that promise to 
you that your data didn't affect this overall tabulation by any 
more than epsilon, and then you take the noisy data and 
re-create the microdata from the tabulated. 

THE COURT: All right. Let me see if I can translate 
this into more plain English. Would there be any way, for 
example, to take the census block just above the E that has a 
one in it — right, that's one person in that census block? 

THE WITNESS: Yes. 

THE COURT: I presume there would be no way to 
disclose the data for that particular person without, at the 
census block level in an accurate way that wouldn't reveal 
things that you're prohibited from revealing under Title 13, is 
that correct? 

THE WITNESS: That's our interpretation of the law, 

yes, sir. 

THE COURT: OK. So by introducing noise, I take it 
you need to go out to a broader geographic range, and in 
essence, you're sort of swapping people between the blocks? 

How does it work? 

THE WITNESS: We're not — excuse me, your Honor. I 
didn't mean to interrupt. 

We're not swapping. We're basically replacing the 
real microdata with microdata that tabulate up accurately as 
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the more — as there are more and more people in the area that 
you're looking at, but in the block that had one person on it, 
basically every characteristic of that person has been infused 
with noise, so changed, if you like. 

THE COURT: So swapped. 

THE WITNESS: Well, swap implies that it came from 
someplace else. That's why — 

THE COURT: But in other words, presumably any change 
up on one dimension or characteristic would have to be matched 
somewhere else by a change down. 

THE WITNESS: The population totals are controlled to 
the national level, that's right. And so are the tabulations 
of the detailed variables, but even the national table has been 
protected except for the population total. 

THE COURT: In other words, if someone, I don't know 
what this red box is, but if someone within this Lee area, the 
local jurisdiction wanted to get accurate citizen voting-age 
population for within that area, is that something that could 
be done consistent with the disclosure restrictions in Title 
13? 

THE WITNESS: Yes, your Honor. 

THE COURT: And how would that be done? 

THE WITNESS: Well, we actually had to work pretty 
hard to do it. We had to design the algorithm so that it could 
publish at the block level so you could build the arbitrary 
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geographic areas that you needed, and the statistics kept 
getting more and more accurate as the number of people in that 
geographic area increased. So there are — 

Perhaps Mr. Ho knows the total of the number of people 
in that red box, but looks like there's about 50 or 60. The 
data will be quite accurate for such advocation. That's enough 
people so that the fact that we added noise to the individual 
data doesn't affect the tabulations very much. 

THE COURT: How many people would you need for it to 
remain accurate but still allow you to mask in the way that 
you're required to do? 

THE WITNESS: So, your Honor, that's not a question 
that can be answered in a vacuum. The way we are doing it is 
when you add the noise this way, you can produce a drawing that 
shows how the accuracy of various tabulations is affected by 
the amount of noise that you've infused, and it gives you the 
feasible levels. If you're going to protect the 
confidentiality, then you have to choose a point on this graph. 

What we have to do is we have to decide, based on the 
use cases for the data, how to allocate that accuracy so that 
it meets the client use cases. So we're evaluating the way we 
will do this at the block level so that it would be useful for 
redistricting and for Section 2 scrutiny under the Voting 
Rights Act, and we have been given test cases from the 
Department of Justice in order to facilitate this evaluation so 
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that we can show them that it's still fit for use. 

We did not ever previously do this. Previously we 
just added the noise and told the users that we weren't going 
to tell them anything about it. 

THE COURT: And maybe this is an unintelligible 
question, but is there a census block size that is adequate 
enough that you would not need to introduce noise in order for 
the relevant data to be masked? 

THE WITNESS: No. You have to introduce noise, your 
Honor, to every block, to every tabulation, but you control the 
amount of noise that you introduce so as to guarantee accuracy 
along the dimensions that the use case requires. 

THE COURT: All right. 

Mr . Ho. 

MR. HO: I may have some questions that might clarify 
some of this, your Honor. 

Q. Dr. Abowd, with respect to what the Census Bureau's done in 
the past, the publicly available technical documents state that 
in the past the Census Bureau has applied household-level 
swapping and synthetic data noise infusion, correct? 

A. That's correct. 

Q. Let's talk about those two different things, and let's 
start with household-level swapping. 

Household-level swapping would be where you take certain 
variables on one household's record and you match them up to 
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the variables on another household's record, located in a 
different geographic area, and then you swap those values 
except the address so that it looks like essentially one 
household lives at one location and the other household lives 
in another location, right? 

A. Yes, that's essentially correct. 

Q. And when you do that, when you've done that in the past, 
you would swap the households across census blocks, correct? 

A. Yes, sir. 

Q. And you do that because there would be no point in swapping 
households within a census block, right? 

A. That's right. 

Q. Now, let's talk about synthetic data noise infusion. 

That's a different technique, right? 

A. That is correct. 

Q. And that's what you were talking about with Judge Furman 
earlier, right? 

A. I was talking about a particular form of that, yes. 

Q. Right, because there are multiple forms of synthetic data 
noise infusion, correct? 

A. They're multiple forms of noise infusion. They don't all 
involve synthetic data. 

Q. Thank you. 

Now, one way of doing noise infusion is to develop a model 
for when you have a particular item or variable on a 
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household's record that's sensitive and then replacing that 
variable as reported by the household with synthetic, 
essentially made-up data based on the model, is that right? 

A. With a draw from the model's predictive distribution, 
that's correct. 

Q. And the idea is that at a high level of geography, like a 
county, the overall aggregate numbers are going to remain 
essentially the same, right. Dr. Abowd? 

A. So, some disclosure-avoidance methods have that property 
and some don't. Without getting into the deep weeds of ones 
that you're talking about, the particular synthetic data 
property that you just described won't have that feature unless 
it is engineered into the synthesizer. 

Q. For the use case that you have here — right — when you're 
talking about higher levels of geographic units, like counties, 
when you infuse the synthetic data, the idea is that the 
aggregate numbers are going to be basically the same? Right? 

A. The idea is not with respect to the geographic area but 
with respect to the population within the geographic area. 

Q. Thank you. 

A. The denser the population the more accurate the statistics. 
Q. OK. So, the larger the population size of the geographic 
area the more accurate the data will remain even after 
synthetic data noise infusion, correct? 

A. After the disclosure-avoidance procedure we're implementing 
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for the 2020 census, that's correct. 

Q. But at the smaller levels of geographic specificity, like 
the individual census block, the more noise there's going to 
be — I mean, in terms of the population — 

MR. HO: Let me start that question again. 

Q. Areas with smaller population sizes — like census blocks 
typically have smaller population sizes than counties — 
there's going to be more noise at that level of geographic 
specificity once you employ noise infusion, correct? 

A. That's correct. 

Q. So, leaving all the noise infusion and the CVAP data using 
responses to the citizenship question, today, when we use ACS 
CVAP data, generally speaking, we have more accuracy at 
geographic levels of specificity that have larger populations 
and more uncertainty at lower levels, correct? 

A. That's correct. 

Q. And that's also going to be true with CVAP data produced 
based on responses to the decennial census question due to 
noise infusion at higher levels of geography with more people, 
more accuracy but greater uncertainty at smaller levels of 
geography with smaller populations, correct? 

A. It's the smaller populations that make the sentence 
correct, and yes, it is, with that qualification. 

Q. Now, the Census Bureau has not yet set the parameters for 
disclosure avoidance for the CVAP table that will be created 
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after the 2020 census, correct? 

A. That's correct. 

Q. If you do data disclosure avoidance properly, then the 
block-level CVAP data that you produce after the 2020 census 
including a citizenship question, the block-level data is going 
to be a series of estimates for each block rather than an exact 
tabulation of census responses, correct? 

A. I have difficulty answering that question because 
"estimates" has a specific legal meaning that's not quite the 
same as the generally understood statistical meaning. The data 
produced for each block and for the entire country and for 
every geographic area in between will be based on the entire 
enumeration, so in that sense not an estimate. 

In the sense that they have been infused with noise to 
protect confidentiality and therefore have margins of error 
that resemble the margins of error that you would get in 
statistical processes that become more accurate as the number 
of cases increases, then it is correct. So they are not 
estimates in the sense that the law understands sample-based 
estimates. They're based on the entire population. 

Q. Well, let's not talk about the law for a moment. I just 
want to — and let's not worry about sample-based estimates, or 
whatever. 

Just in your words. Dr. Abowd, you would describe the 
block-level CVAP data that's produced even after a citizenship 
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question is on the census as an estimate rather than a precise 
tabulation, correct? 

A. Yes. 

Q. So the block-level CVAP tabulation produced by the Census 
Bureau will not reflect the actual values of the number of 
citizens of voting age in each of those census blocks after the 
2020 census, correct? 

A. It will not be exactly equal to that number. It will be 
approximately equal to that number, with the approximation 
improving as the population increases. 

Q. And after the 2020 decennial census even if there is a 
citizenship question, when the Census Bureau produces 
block-level CVAP data, there will be error margins associated 
with that data, correct? 

A. Yes. 

Q. And after the 2020 decennial census, when the Census Bureau 
produces block-level CVAP data, even if there is a citizenship 
question on the census, as of right now, the Census Bureau 
doesn't know whether the margins of error associated with that 
block-level CVAP data will be larger or smaller than the CVAP 
data that DOJ currently uses, correct? 

A. We don't know, but we are able to control the margin of 
error in different ways, and so we intend to produce those 
tables in a manner that is fit for use by the Department of 
Justice. 
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Q. But you don't know right now whether or not the margins of 
error associated with block-level CVAP data produced after the 
2020 census, assuming that there's a citizenship question on 
it, that those block-level estimates will have margins of error 
that are any smaller than the block-level CVAP data that DOJ 
currently relies on, correct? 

A. I'd like to answer your question, Mr. Ho, but the DOJ 
doesn't currently work with any block-level CVAP data, so — 

Q. Well, the DOJ does translate ACS CVAP data at one level of 
geographic specificity and combines it with decennial census 
data to produce block-level CVAP estimates, correct? 

A. That's not my understanding of how it's done. My 
understanding of how it's done is that they combine block-level 
CVAP data with block-level other data, PL 94 data, and they 
estimate the citizen population in the voting districts that 
they're trying to supply — to do scrutiny of. Sometimes that 
involves having to model down to the block level, but it 
doesn't always. 

Q. OK. Dr. Abowd, this is a very simple question. The CVAP 
data that the Census Bureau's going to produce after the 2020 
census, assuming that the 2020 census includes a citizenship 
question, we don't know today whether or not that data will 
have margins of error that are any more precise than the CVAP 
data on which the Department of Justice currently relies, 
correct? 
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A. Because the parameters have not been set, the answer to 
that question has to be yes. 

Q. Dr. Abowd, there were never any conversations between the 
Department of Justice and the Census Bureau about this issue 
prior to Secretary Ross's issuance of his decision memo 
ordering the inclusion of the citizenship question on the 
census, correct? 

A. That's correct. 

Q. DOJ refused to meet with you to discuss, right? 

A. So, I don't know that DOJ would have refused to meet with 
us to discuss disclosure avoidance on the PL 94 and CVAP table. 
All I know is that they didn't meet with us to discuss the 
specific request about adding a citizenship question to the 
2020 census. 

Q. During that whole process, between when you began your 
analysis with the SWAT team and when Secretary Ross issued his 
decision memo, there were never any conversations between 
commerce and the Census Bureau about how disclosure avoidance 
might affect the precision of the CVAP data that the Census 
Bureau could produce after the 2020 census, correct? 

A. Not entirely. I had already briefed Undersecretary Kelley 
on the consequences of modernizing the disclosure-avoidance 
system at the Census Bureau. I briefed her, I believe, in 
November of 2017. 

Q. That was before you began working on the citizenship 
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question, right. Dr. Abowd? 

A. That's correct. 

Q. OK. My question was meant to be a little more precise, and 
I apologize if I didn't word it correctly. But my question is 
from the time that you started analyzing the citizenship 
question request from the Department of Justice to when 
Secretary Ross issued his decision memo, there were no 
conversations between the Census Bureau and commerce department 
officials about whether disclosure avoidance might affect the 
precision of the block-by-block CVAP data that the Census 
Bureau could produce based on responses to the citizenship 
question on the census, correct? 

A. Not quite. We did, both in discussing it with the 
secretary and in discussing it with the undersecretary, remind 
them both that we would be using disclosure-avoidance 
procedures at the block level. 

Q. And in spite of that reminder, the secretary forged ahead 
and ordered a citizenship question anyway, right. Dr. Abowd? 

A. The secretary was aware of our intention to use disclosure 
avoidance — 

Q. There are no documents in the administrative record that 
you're aware of. Dr. Abowd, that reflect the way in which 
disclosure avoidance might affect the precision of 
block-by-block CVAP data that the Department of Justice was 
requesting from the Census Bureau through a citizenship 
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question on the census, correct? 

A. That's correct. 

MR. HO: Let's go back to Secretary Ross's memo. 
Plaintiffs' Exhibit 26. I want to go to page 8. 

Q. Secretary Ross says that he has determined that 
reinstatement of a citizenship question on the 2020 decennial 
census is necessary to provide complete and accurate data in 
response to the DOJ request. Do you see that? 

A. Yes, I do. 

Q. Dr. Abowd, you don't agree that a citizenship question on 
the 2020 census is necessary to provide a complete and 
accurate, to provide complete and accurate data in response to 
the DOJ request, correct? 

A. That's correct. 

Q. And Dr. Abowd, the position of the Census Bureau is that a 
citizenship question on the 2020 decennial census is not 
necessary to provide complete and accurate data in response to 
the DOJ request, correct? 

A. That's correct. 

MR. HO: Dr. Abowd, I don't have any other questions 
for you right now, but your Honor, the plaintiffs, because we 
still have a few exhibit issues to sort out, although my 
questioning of Dr. Abowd is complete, we would not like to 
close the record just yet. 

THE COURT: All right. I also assume you want to 
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